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Preface 


This text is an outgrowth of lectures given at the University of Windsor, 
Canada. One of our main objectives is updating the undergraduate analysis 
as a rigorous postcalculus course. While such excellent books as Dieudonné’s 
Foundations of Modern Analysis are addressed mainly to graduate students, 
we try to simplify the modern Bourbaki approach to make it accessible to 
sufficiently advanced undergraduates. (See, for example, §4 of Chapter 5.) 

On the other hand, we endeavor not to lose contact with classical texts, 
still widely in use. Thus, unlike Dieudonné, we retain the classical notion of a 
derivative as a number (or vector), not a linear transformation. Linear maps 
are reserved for later (Volume II) to give a modern version of differentials. 
Nor do we downgrade the classical mean-value theorems (see Chapter 5, §2) or 
Riemann-Stieltjes integration, but we treat the latter rigorously in Volume II, 
inside Lebesgue theory. First, however, we present the modern Bourbaki theory 
of antidifferentiation (Chapter 5, §5 ff.), adapted to an undergraduate course. 

Metric spaces (Chapter 3, §11 ff.) are introduced cautiously, after the n- 
space E”, with simple diagrams in EL? (rather than E°), and many “advanced 
calculus” -type exercises, along with only a few topological ideas. With some 
adjustments, the instructor may even limit all to E” or E? (but not just to the 
real line, E'), postponing metric theory to Volume II. We do not hesitate to 
deviate from tradition if this simplifies cumbersome formulations, unpalatable 
to undergraduates. Thus we found useful some consistent, though not very 
usual, conventions (see Chapter 5, §1 and the end of Chapter 4, §4), and 
an early use of quantifiers (Chapter 1, §1-3), even in formulating theorems. 
Contrary to some existing prejudices, quantifiers are easily grasped by students 
after some exercise, and help clarify all essentials. 

Several years’ class testing led us to the following conclusions: 


(1) Volume I can be (and was) taught even to sophomores, though they only 
gradually learn to read and state rigorous arguments. A sophomore often 
does not even know how to start a proof. The main stumbling block 
remains the ¢, d-procedure. As a remedy, we provide most exercises with 
explicit hints, sometimes with almost complete solutions, leaving only 
tiny “whys” to be answered. 


(2) Motivations are good if they are brief and avoid terms not yet known. 
Diagrams are good if they are simple and appeal to intuition. 


(3) 


Preface 


Flexibility is a must. One must adapt the course to the level of the class. 
“Starred” sections are best deferred. (Continuity is not affected.) 


“Colloquial” language fails here. We try to keep the exposition rigorous 
and increasingly concise, but readable. 


It is advisable to make the students preread each topic and prepare ques- 
tions in advance, to be answered in the context of the next lecture. 


Some topological ideas (such as compactness in terms of open coverings) 
are hard on the students. Trial and error led us to emphasize the se- 
quential approach instead (Chapter 4, 86). “Coverings” are treated in 
Chapter 4, §7 (“starred”). 


To students unfamiliar with elements of set theory we recommend our 
Basic Concepts of Mathematics for supplementary reading. (At Windsor, 
this text was used for a preparatory first-year one-semester course.) The 
first two chapters and the first ten sections of Chapter 3 of the present 
text are actually summaries of the corresponding topics of the author’s 
Basic Concepts of Mathematics, to which we also relegate such topics as 
the construction of the real number system, etc. 


For many valuable suggestions and corrections we are indebted to H. Atkin- 
son, F. Lemire, and T. Traynor. Thanks! 


Publisher’s Notes 


Chapters 1 and 2 and 881-10 of Chapter 3 in the present work are sum- 
maries and extracts from the author’s Basic Concepts of Mathematics, also 
published by the Trillia Group. These sections are numbered according to 
their appearance in the first book. 


Several annotations are used throughout this book: 


* 


This symbol marks material that can be omitted at first reading. 


=> This symbol marks exercises that are of particular importance. 


About the Author 


Elias Zakon was born in Russia under the czar in 1908, and he was swept 
along in the turbulence of the great events of twentieth-century Europe. 

Zakon studied mathematics and law in Germany and Poland, and later he 
joined his father’s law practice in Poland. Fleeing the approach of the German 
Army in 1941, he took his family to Barnaul, Siberia, where, with the rest of 
the populace, they endured five years of hardship. The Leningrad Institute of 
Technology was also evacuated to Barnaul upon the siege of Leningrad, and 
there he met the mathematician I. P. Natanson; with Natanson’s encourage- 
ment, Zakon again took up his studies and research in mathematics. 

Zakon and his family spent the years from 1946 to 1949 in a refugee camp 
in Salzburg, Austria, where he taught himself Hebrew, one of the six or seven 
languages in which he became fluent. In 1949, he took his family to the newly 
created state of Israel and he taught at the Technion in Haifa until 1956. In 
Israel he published his first research papers in logic and analysis. 

Throughout his life, Zakon maintained a love of music, art, politics, history, 
law, and especially chess; it was in Israel that he achieved the rank of chess 
master. 

In 1956, Zakon moved to Canada. As a research fellow at the University of 
Toronto, he worked with Abraham Robinson. In 1957, he joined the mathemat- 
ics faculty at the University of Windsor, where the first degrees in the newly 
established Honours program in Mathematics were awarded in 1960. While 
at Windsor, he continued publishing his research results in logic and analysis. 
In this post-McCarthy era, he often had as his house-guest the prolific and 
eccentric mathematician Paul Erdés, who was then banned from the United 
States for his political views. Erdés would speak at the University of Windsor, 
where mathematicians from the University of Michigan and other American 
universities would gather to hear him and to discuss mathematics. 

While at Windsor, Zakon developed three volumes on mathematical analysis, 
which were bound and distributed to students. His goal was to introduce 
rigorous material as early as possible; later courses could then rely on this 
material. We are publishing here the latest complete version of the second of 
these volumes, which was used in a two-semester class required of all second- 
year Honours Mathematics students at Windsor. 


Chapter 1 
Set Theory 


§§1-3. Sets and Operations on Sets. Quantifiers 


A set is a collection of objects of any specified kind. Sets are usually denoted 
by capitals. The objects belonging to a set are called its elements or members. 
We write x € A if x is a member of A, and x ¢ A if it is not. 

A = {a, b,c,...} means that A consists of the elements a, b,c,.... In 
particular, A = {a, b} consists of a and b; A = {p} consists of p alone. The 
empty or void set, 0, has no elements. Equality (=) means logical identity. 

If all members of A are also in B, we call A a subset of B (and B a superset 
of A), and write A C B or BD A. It is an axiom that the sets A and B are 
equal (A = B) if they have the same members, i.e., 


ACBand BCA. 


If, however, A C B but B Z A (i.e., B has some elements not in A), we call A 
a proper subset of B and write AC Bor BDA. “C” is called the inclusion 
relation. 


Set equality is not affected by the order in which elements appear. Thus 
{a, b} = {b, a}. Not so for ordered pairs (a, b).' For such pairs, 


(a,b) =(z, y) iff? a=aandb=y, 
but not ifa=yandb=2. Similarly, for ordered n-tuples, 
(Oiiis dk iy VS iy ee eng a WE pay HH, 2 cas 


We write {x | P(x)} for “the set of all x satisfying the condition P(z).” 
Similarly, {(z, y) | P(x, y)} is the set of all ordered pairs for which P(z, y) 
holds; {a € A | P(ax)} is the set of those x in A for which P(x) is true. 


1 See Problem 6 for a definition. 
? Short for if and only if; also written <>. 
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For any sets A and B, we define their union AU B, intersection AN B, 
difference A— B, and Cartesian product (or cross product) A x B, as follows: 
AUB is the set of all members of A and B taken together: 


{g|a2e Aorag € BY. 
AM B is the set of all common elements of A and B: 
{rE A|axe B}. 
A — B consists of those x € A that are not in B: 
{cE Ala ¢ B}. 
A x B is the set of all ordered pairs (x, y), with x € A and y € B: 
{(z, y)|xeEA, ye B}. 


Similarly, Ay x Ag x---x Ay, is the set of all ordered n-tuples (x1, ..., 2) such 
that rz, € Ap, kK =1, 2,...,. We write A” for A x A x---x A (n factors). 

A and B are said to be disjoint iff AN B = @ (no common elements). 
Otherwise, we say that A meets B (AM B #9). Usually all sets involved are 
subsets of a “master set” S, called the space. Then we write —X for S— X, 
and call —X the complement of X (in S). Various other notations are likewise 
in use. 


Examples. 
Let A= {1, 2, 3}, B= {2, 4}. Then 
AUB={l1,2,3,44, ANB={2}, A-—B= {l, 3}, 
AxB= hae 2), Oly 4), (2, 2), (2, 4), (3, 2), (3, Ay}. 
If N is the set of all naturals (positive integers), we could also write 


A={rEN|a <4}. 


Theorem 1. 
(a) AUA=A; ANA=A,; 
(b) AUB=BUA, ANB=BNA4; 


) 
(c) (AUB)UC = AU(BUC); (ANB)NC = AN(BNC); 
(d) (AUB)NC =(ANC)U(BNC): 
(ec) (ANB)UC =(AUC)N(BUC). 


3 The word “or” is used in the inclusive sense: “P or Q” means “P or Q or both.” 
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The proof of (d) is sketched in Problem 1. The rest is left to the reader. 

Because of (c), we may omit brackets in AU BUC and AN BNC; similarly 
for four or more sets. More generally, we may consider whole families of sets, 
i.e., collections of many (possibly infinitely many) sets. If M is such a family, 
we define its union, J) M, to be the set of all elements x, each belonging to at 
least one set of the family. The intersection of M, denoted ()M, consists of 
those x that belong to all sets of the family simultaneously. Instead, we also 
write 


{x | X € M} and (\{x | X € M}, respectively. 
Often we can number the sets of a given family: 
Ag Aa, aig Aggy orice 


More generally, we may denote all sets of a family M by some letter (say, X ) 
with indices i attached to it (the indices may, but need not, be numbers). The 
family M then is denoted by {X;} or {X; | i € I}, where 7 is a variable index 
ranging over a suitable set J of indices (“index notation”). In this case, the 
union and intersection of M are denoted by such symbols as 


Uealie =U xX =U% =U Xs 
a tel 

(MX lie T=) Xi =() Xi = ()X- 
a tel 


If the indices are integers, we may write 


U Kos v Xn; 0) Xn, ete. 
n=1 n=] nk 


Theorem 2 (De Morgan’s duality laws). For any sets S and A; (i € I), the 
following are true: 


) S- eae Ai); (ii) S- a Us- Ai). 


(If S is the entire space, we may write —A,; for S— A;, —\J A; for S—U Ai, 
etc.) 

Before proving these laws, we introduce some useful notation. 

Logical Quantifiers. From logic we borrow the following abbreviations. 


“(Va € A) ...” means “For each member z of A, it is true that ....” 


“(Sa eA)...” means “There is at least one x in A such that ....” 


“(Ala € A) ...” means “There is a unique x in A such that ....” 
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The symbols “(Va € A)” and “(da € A)” are called the universal and 
existential quantifiers, respectively. If confusion is ruled out, we simply write 


“(Va),” “(da),” and “(4!a)” instead. For example, if we agree that m, n 
denote naturals, then 


"Val lam): mn" 


” 


means “For each natural n, there is a natural m such that m > n.” We give 
some more examples. 

Let M = {A; | 7 € I} be an indexed set family. By definition, « € UA; 
means that x is in at least one of the sets A;, i € J. In other words, there is at 
least one index i € I such that x € A;; in symbols, 


(diel) crEeAj. 


Thus we note that 


xe|JAi iff [Bie 2) e Ail. 
wel 


Similarly, 
xe()Ay iff (Viel) we Ail. 


Also note that « ¢ (J A; iff x is in none of the Aj, i-e., 


Similarly, x ¢ () A; iff x fails to be in some Aj, i-e., 
(di) a2 €A;. (Why?) 


We now use these remarks to prove Theorem 2(i). We have to show that 
S — (JA; has the same elements as ()(S — A;), ie., that 2 € S —UA,; iff 
x €f(\(S —A;). But, by our definitions, we have 


xES—| JA, <> [zeS, x ¢|JAiJ 
<> (Vi) [x € S, x ¢ Ai] 
<> (Vi) cE S-A; 
<> XE (\(s — A;), 
as required. 
One proves part (ii) of Theorem 2 quite similarly. (Exercise!) 
We shall now dwell on quantifiers more closely. Sometimes a formula P(x) 


holds not for all x € A, but only for those with an additional property Q(z). 
This will be written as 


(VaEA|Q(x)) P(e), 
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where the vertical stroke stands for “such that.” For example, if N is again 
the naturals, then the formula 


(VaEN|a>3) r>4 (1) 


means “for each x € N such that x > 3, it is true that x > 4.” In other words, 
for naturals, x > 3 => x > 4 (the arrow stands for “implies”). Thus (1) can 
also be written as 

(VW2eN) 23954 


In mathematics, we often have to form the negation of a formula that starts 
with one or several quantifiers. It is noteworthy, then, that each universal 
quantifier is replaced by an existential one (and vice versa), followed by the 
negation of the subsequent part of the formula. For example, in calculus, a real 
number p is called the limit of a sequence x1, ©2,..., Xn, ... iff the following 
is true: 


For every real ¢ > 0, there is a natural k (depending on ¢) such that, for 
all natural n > k, we have |x, — p| < e. 


If we agree that lower case letters (possibly with subscripts) denote real num- 
bers, and that n, k denote naturals (n, k € N), this sentence can be written 
as 


(Ve >0) (Sk) (Vn>k) |rn —p| <e. (2) 


Here the expressions “(Ve > 0)” and “(Vn > k)” stand for “(Ve | € > 0)” 
and “(Vn |n->k)”, respectively (such self-explanatory abbreviations will also 
be used in other similar cases). 

Now, since (2) states that “for all « > 0” something (i.e., the rest of (2)) is 
true, the negation of (2) starts with “there is an « > 0” (for which the rest of 
the formula fails). Thus we start with “(de > 0)”, and form the negation of 
what follows, i.e., of 


(Ak) (Vn>k) |an—-p| <e. 


This negation, in turn, starts with “(Vk)”, etc. Step by step, we finally arrive 
at 


— 


de>0) (Vk) (An>k) |tn—pl|>e. 


Note that here the choice of n > k may depend on k. To stress it, we often 
write n; for n. Thus the negation of (2) finally emerges as 


(Se >0) (Vk) (Ang>k) |en, —pl >e- (3) 


The order in which the quantifiers follow each other is essential. For exam- 
ple, the formula 


(VnEN)(AmeEN) m>n 
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(“each n € N is exceeded by some m € N”) is true, but 


(Ame N)(VnEN) m>n 


is false. However, two consecutive universal quantifiers (or two consecutive 
existential ones) may be interchanged. We briefly write 


“(Va, y € A)” for “(Va € A) (Vy € A),” 


and 


“(4a, y € A)” for “(daz € A) (Ay € A),” ete. 


We conclude with an important remark. The universal quantifier in a for- 
mula 


(VaeEA) P(x) 


does not imply the existence of an x for which P(x) is true. It is only meant 
to imply that there is no x in A for which P(x) fails. 

The latter is true even if A = 0; we then say that “(Va € A) P(a)” is 
vacuously true. For example, the formula 0 C B, ice., 


(VaeQ) ceB, 


is always true (vacuously). 


Problems in Set Theory 


1. Prove Theorem 1 (show that x is in the left-hand set iff it is in the 
right-hand set). For example, for (d), 


ze (AUB)NC => [zr € (AUB) and zeC| 
[((2€ Aorze B), andxreC] 
( 


—= 
<> |[(4E€A,x eEC)or(#@eB,rEeC)|. 


2. Prove that 
QS =4)—4 
(ii) AC Biff -—BC-A. 
3. Prove that 
A-—B=AN(-B) = (-B) - (—A) = -[(-—A) U B]. 
Also, give three expressions for ANB and AUB, in terms of complements. 


4. Prove the second duality law (Theorem 2(ii)). 
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5. Describe geometrically the following sets on the real line: 


(i) {@ | « < 0}; (ii) {2 | |x| < 1}; 
(iii) {a | |x —a] < e}; liv) {ao |) a< 2 < bts 
(v) {a | |a| < Of. 


6. Let (a, b) denote the set 
{{a}, {a, bf} 
(Kuratowski’s definition of an ordered pair). 


(i) Which of the following statements are true? 


(a) a € (a, b); (b) {a} € (a, 6); 
(c) (a, a) = {a}; (d) 6 € (a, 8); 
(e) {b} € (a, b); (f) {a, b} € (a, 6). 


(ii) Prove that (a, b) = (uw, v) ofa=u end b=v. 
[Hint: Consider separately the two cases a = b and a ¥ b, noting that {a, a} = 
{a}. Also note that {a} 4 a.] 


7. Describe geometrically the following sets in the xy-plane. 


(i) {(z, y) |e <y}s 
(ay {x9 (ara <1 
(iii) {(x, y) | max(lal, |yl) < 1}; 
(iv) {(z, y) | y > 27}; 
(v) {(2, y) | lz] + lyl < 4}; 
(vi) {(a, y) | @ — 2)? + (y+5)? < 9}; 
(vii) {(x, y) | x = 0}; 
(viii) {(a, y) | x? — 2ay + y? < 0}; 
(ix) {(a, y) | x? —2xry + y? =O}. 


8. Prove that 
(i) (AUB)xC=(AxC)U(BxQ); 
(ii) (ANB) x (COND) =(Ax C)n (Bx D); 
(iii) (X x Y)-— (X' x Y’) = [(X NX") x (Y —Y")| U[(X — X’) x YI. 


[Hint: In each case, show that an ordered pair (ax, y) is in the left-hand set iff it is 
in the right-hand set, treating (x, y) as one element of the Cartesian product.] 


9. Prove the distributive laws 
(ii) AUP) X; =(\(AU X;); 
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(iii) (Xi) — A =1(%; - A); 
(iv) (UX) - A =UC% — A); 
(vy) NXLUNY; =, (Xi Y5)s* 
(vi) UXiNUY; =U; (iY). 
10. Prove that 
(i) 


( B 
(ii) (Q.Ai) x B=(\(A; x B); 
(ii) (N; Aa) x (Nj Bs) =1i,;(Ae x Ba); 
(iv) (U; Ai) x (U; Bs) = Ui, j(Ai x B;) 


§§4-7. Relations. Mappings 


In 881-3, we have already considered sets of ordered pairs, such as Cartesian 
products A x B or sets of the form {(z, y) | P(x, y)} (cf. §81-3, Problem 7). 
If the pair (x, y) is an element of such a set R, we write 


(a, y) eR, 


treating (x, y) as one thing. Note that this does not imply that x and y taken 
separately are members of R (in which case we would write x, y € R). We call 
x, y the terms of (a, y). 

In mathematics, it is customary to call any set of ordered pairs a relation. 
For example, all sets listed in Problem 7 of 881-3 are relations. Since relations 
are sets, equality R = S for relations means that they consist of the same 
elements (ordered pairs), i.e., that 


(a, y) € R= (a, y) ES. 


If (x, y) € R, we call y an R-relative of x; we also say that y is R-related 
to x or that the relation R holds between x and y (in this order). Instead of 
(x, y) € R, we also write Ry, and often replace “R” by special symbols like 
<, ~, etc. Thus, in case (i) of Problem 7 above, “xRy” means that x < y. 

Replacing all pairs (z, y) € R by the inverse pairs (y, x), we obtain a new 
relation, called the inverse of R and denoted R~!. Clearly, eR7!y iff yRz; 
thus 


RR ={ (2,9) |gha} =1y,2) |ary}. 


“Here we work with two set families, {X; | i € I} and {Y; | 7 € J}; similarly in other 
such cases. 
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Hence R, in turn, is the inverse of R7!; ice., 
(A) SR. 


For example, the relations < and > between numbers are inverse to each other; 
so also are the relations C and D between sets. (We may treat “C” as the name 
of the set of all pairs (X, Y) such that X CY in a given space.) 


If R contains the pairs (xz, x’), (y, y’), (z, 2’), ..-, we shall write 


_(&@ yz  \, _f1 4 1 3 
R= & y! 2! i €.g., R= e y) 1 1 ° (1) 


To obtain R~!, we simply interchange the upper and lower rows in (1). 
Definition 1. 


The set of all left terms x of pairs (x, y) € R is called the domain of R, 
denoted Dr. The set of all right terms of these pairs is called the range 
of R, denoted D'p. Clearly, « € Dr iff Ry for some y. In symbols, 


z€ De <= (Ay) Ry; similarly, y € Dp => (Az) cRy. 


In (1), Dr is the upper row, and D‘, is the lower row. Clearly, 


Dat — Dr and Dip-1 = Dr. 


141 
ae 2 a 


DR = D'p-1 _ ae 4} and DR = Dp = al 2h. 


For example, if 


then 


Definition 2. 


The image of a set A under a relation R (briefly, the R-image of A) is the 
set of all R-relatives of elements of A, denoted R[A]. The inverse image 
of A under R is the image of A under the inverse relation, i.e., R~*[A]. 
If A consists of a single element, A = {x}, then R[A] and R~1[A] are also 
written R[x] and R~{[2], respectively, instead of R[{x}] and R71[{z}}. 


Example. 


Let 


es ae ee a aes a 
R=( 345 3:4 1 3.5 {),4= {12h B= 12,4} 
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Then 

Rij=t1.354) R{2] = {3, 5}; R{3] = {1, 3, 4, 5} 
R[5| = 0; R11 ={1,3,7 RP] =9; 

A = 41,23); pa ee Oe RA) = 41,3, 5) 


A Alaq13,7 RIB) = 43,5) 


By definition, R[z] is the set of all R-relatives of x. Thus 
ye Rix] if (2, y)e Rie, Ry. 


More generally, y € R[A] means that (x, y) € R for some x € A. In symbols, 


y © R[A] — > (Sr € A) (2, y) ER. 
Note that R[A] is always defined. 
We shall now consider an especially important kind of relation. 
Definition 3. 


A relation R is called a mapping (map), or a function, or a transfor- 
mation, iff every element « € Dr has a unique R-relative, so that R{:] 
consists of a single element. This unique element is denoted by R(x) and 
is called the function value at x (under R). Thus R(x) is the only member 
of R[z}." 


If, in addition, different elements of Dr have different images, R is called a 
one-to-one (or one-one) map. In this case, 


a #y (#,y € Dr) implies R(x) # Rly); 


equivalently, 
R(x) = R(y) implies x = y. 


In other words, no two pairs belonging to R have the same left, or the same 
right, terms. This shows that R is one to one iff R~', too, is a map.? Mappings 
are often denoted by the letters f, g, h, F, w, etc. 


| Equivalently, R is a map iff (x, y) € R and (2, z) € R implies that y = z. (Why?) 
? Note that R~! always exists as a relation, but it need not be a map. For example, 


123 4 
carer) 


+f? 2-3 8 
eG 


is not. (Why?) Here f is not one to one. 


is a map, but 
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A mapping f is said to be “from A to B” iff Dy = A and D’, C B; we then 
write 


f:A—-7B (“f maps A into B”). 
If, in particular, Dy = A and D’. = B, we call f a map of A onto B, and we 
write 
f:A—B (“f maps A onto B”). 


onto 


If f is both onto and one to one, we write 


f: Acco B 


onto 


(f: A<> B means that f is one to one). 

All pairs belonging to a mapping f have the form (zx, f(x)) where f(z) is 
the function value at 2, i.e., the unique f-relative of x, 7 € Dy. Therefore, in 
order to define some function f, it suffices to specify its domain Dy and the 
function value f(a) for each x € Dy. We shall often use such definitions. It is 
customary to say that f is defined on A (or “f is a function on A”) iff A= Dr. 
Examples. 

(a) The relation 


R= {(az, y) | x is the wife of y} 


is a one-to-one map of the set of all wives onto the set of all husbands. 
R~" is here a one-to-one map of the set of of all husbands (= D’‘,) onto 
the set of all wives (= Dr). 


(b) The relation 
f = {(2, y) | y is the father of x} 


is a map of the set of all people onto the set of their fathers. It is not one 
to one since several persons may have the same father (f-relative), and 


so x # x’ does not imply f(x) f(z’). 


(c) Let 
fi 23 4 
2 \9: By gy" 


Then g is a map of Dg = {1, 2, 3, 4} onto Di = {2, 3, 8}, with 


g(1) = 2, 9(2) =2, 9(3) =3, (4) =8. 


(As noted above, these formulas may serve to define g.) It is not one to 
one since g(1) = g(2), so g~! is not a map. 
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(d) Consider 
f: NN, with f(x) = 22 for each « € N.? 


By what was said above, f is well defined. It is one to one since x 4 y 
implies 2x # 2y. Here Dy = N (the naturals), but Di consists of even 
naturals only. Thus f is not onto N (it is onto a smaller set, the even 
naturals); f~' maps the even naturals onto all of N. 


The domain and range of a relation may be quite arbitrary sets. In partic- 
ular, we can consider functions f in which each element of the domain Dy is 
itself an ordered pair (x, y) or n-tuple (x1, v2, ..., 2). Such mappings are 
called functions of two (respectively, n) variables. To any n-tuple (11, ..., Ln) 
that belongs to Dy, the function f assigns a unique function value, denoted by 
f(x1,.--, @n). It is convenient to regard x1, %2, ..., Zn as certain variables; 
then the function value, too, becomes a variable depending on the 71, ..., pn. 
Often Dy consists of all ordered n-tuples of elements taken from a set A, 
i.e., Dz = A” (cross-product of n sets, each equal to A). The range may 
be an arbitrary set B; so f: A” > B. Similarly, f: A x B > C is a function 
of two variables, with Dr = A x B, D; eC. 

Functions of two variables are also called (binary) operations. For example, 
addition of natural numbers may be treated as a map f: N x N > N, with 
f(z, y)=at+y. 

Definition 4. 
A relation R is said to be 


(i) reflexive iff we have xRx for each x € Dp; 
(ii) symmetric iff eRy always implies yRz; 


(iii) transitive iff xRy combined with yRz always implies rRz. 


R is called an equivalence relation on a set A iff A = Dr and R has all the 
three properties (i), (ii), and (iii). For example, such is the equality relation on 
A (also called the identity map on A) denoted 


I,=41 8.9) | Sea, v= yh. 


Equivalence relations are often denoted by special symbols resembling equality, 
such as =, &, ~, etc. The formula «Ry, where R is such a symbol, is read 


“x is equivalent (or R-equivalent) to y,” 


3 This is often abbreviated by saying “consider the function f(a) = 2x on N.” However, 
one should remember that f(x) is actually not the function f (a set of ordered pairs) but 
only a single element of the range of f. A better expression is “f is the map x > 2x on N” 
or “f carries x into 2x (x € N).” 
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and R[x] = {y | eRy} (i.e., the R-image of x) is called the R-equivalence class 
(briefly R-class) of x in A; it consists of all elements that are R-equivalent to 
x and hence to each other (for xRy and «Rz imply first yRx, by symmetry, 
and hence yRz, by transitivity). Each such element is called a representative 
of the given R-class, or its generator. We often write [x] for R[x]. 


Examples. 
(a’) The inequality relation < between real numbers is transitive since 
x<yand y < z implies x < 2; 
it is neither reflexive nor symmetric. (Why?) 
(b’) The inclusion relation C between sets is reflexive (for A C A) and tran- 
sitive (for A C B and B CC implies A C C), but it is not symmetric. 


(c’) The membership relation € between an element and a set is neither re- 
flexive nor symmetric nor transitive (x € A and A € M does not imply 
re WM). 

(d’) Let R be the parallelism relation between lines in a plane, i.e., the set of 
all pairs (X, Y), where X and Y are parallel lines. Writing || for R, we 
have X || X, X || Y implies Y |] X, and (X || Y and Y || Z) implies 
X || Z, so R is an equivalence relation. An R-class here consists of all 
lines parallel to a given line in the plane. 


(e’) Congruence of triangles is an equivalence relation. (Why?) 
Theorem 1. /f R (also written =) is an equivalence relation on A, then all 
R-classes are disjoint from each other, and A is their union. 


Proof. Take two R-classes, [p] 4 |g]. Seeking a contradiction, suppose they 
are not disjoint, so 


(Ax) ax € [p] and z€ [qd]; 
i.e., p= x =q and hence p= q. But then, by symmetry and transitivity, 
ye bl ey=pey=aqeye (a 


i.e., [p] and [gq] consist of the same elements y, contrary to assumption [p| F [q]. 
Thus, indeed, any two (distinct) R-classes are disjoint. 
Also, by reflexivity, 
(VaE A) v=a, 


i.e., x € [x]. Thus each x € A is in some R-class (namely, in [z]); so all of A is 
in the union of such classes, 


AC|JRizI. 
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Conversely, 
(Ve) Riz] CA 


since 
y€ Rial] >cRy> yRe= (y, 2) €Reye DrR=A, 


by definition. Thus A contains all R[x], hence their union, and so 


A= J Riz] 


Problems on Relations and Mappings 


1. For the relations specified in Problem 7 of §§1-3, find Dr, D’,, and R7!. 
Also, find R[A] and R~!{A] if 


(a) A= {3}: (b) A= {1}; 
(c) A= {0}; (d) A= 90; 
(e) A= {0, 3, —15}; (f} A= {8,A4, 70, =1; 6 
(g) A= {x |-20<a2< 5}. 
2. Prove that if A C B, then R[A] C R[B]. Disprove the converse by a 
counterexample. 
3. Prove that 
(i) RIAU B] = R[A] U R[B); 


)= RIA] 
(ii) R[ANB] C R[A|NR 
(iii) R[A—B] D R[A] — RIB). 


Disprove reverse inclusions in (ii) and (iii) by examples. Do (i) and (ii) 
with A, B replaced by an arbitrary set family {A; |i € I}. 


4. Under which conditions are the following statements true? 
(i) Rix] = 9; (ii) Ro"[x] = 0; 
(iii) R[A] = 0; (iv) R7*[A] = 0. 
5. Let f: N > N (N = {naturals}). For each of the following functions, 


specify f[N], i-e., D, and determine whether f is one to one and onto 
N, given that for all x € N, 


(i) f(z)=2°; (ii) f(x) = 

(iv) f(@)=275— (v) f(z) 
Do all this also if N denotes 
(a) the set of all integers; 


(iii) f(x) = |x| + 3; 
ea Ds 


| 
se 
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6. 


§8. Sequences 


(b) the set of all reals. 
Prove that for any mapping f and any sets A, B, A; (i€ I), 
(a) f [AUB] = f-"[A]U f-"[B); 
(b) fAN Bl =f“ [A] f-"[B); 
(c) f-*[A- B] = f*[A] — f-"[B); 
(d) f-*[U; Ad = U; f7*TAd: 
(e) f-IN: Ad =; f-*TAdl- 


Compare with Problem 3. 
[Hint: First verify that « € f—1[A] iff € Dy and f(x) € A| 


. Let f be a map. Prove that 


(a) fLf~*[A]] € A; 

(b) f[f [Al] = A if AC D4; 

(c) if AC Dy and f is one to one, A = f~'[f[Al]]. 
Is f[AJN BC f[An f-"[B]]? 


. Is R an equivalence relation on the set J of all integers, and, if so, what 


are the R-classes, if 
(a) R= {(x, y) | x —y is divisible by a fixed n}; 
(b) R= {(x, y) | a —y is odd}; 
(c) R= {(a, y) | x—y is a prime}. 


(x, y, n denote integers.) 


. Is any relation in Problem 7 of 881-3 reflexive? Symmetric? Transitive? 


10. 


Show by examples that R may be 
(a) reflexive and symmetric, without being transitive; 
(b) reflexive and transitive without being symmetric. 


Does symmetry plus transitivity imply reflexivity? Give a proof or 
counterexample. 


1 


By an infinite sequence (briefly sequence) we mean a mapping (call it wu) whose 
domain is N (all natural numbers 1, 2, 3, ...); D, may also contain 0. 


1 This section may be deferred until Chapter 2, §13. 
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A finite sequence is a map u in which D,, consists of all positive (or non- 


negative) integers less than a fixed integer p. The range Di, of any sequence u 
may be an arbitrary set B; we then call wu a sequence of elements of B, or in 


B. For example, 
123 4 ... n ... 
w= (3 468 ... 2Qn ~) (1) 


D, = N = {1, 2, 3,...} 


is a sequence with 


Instead of u(n) we usually write u, (“index notation”), and call u, the nth 
term of the sequence. If n is treated as a variable, uy, is called the general term 
of the sequence, and {u,,} is used to denote the entire (infinite) sequence, as 
well as its range D/, (whichever is meant, will be clear from the context). The 
formula {u,} C B means that Di, C B, i.e., that u is a sequence in B. To 
determine a sequence, it suffices to define its general term u,, by some formula 
or rule.” In (1) above, un = 2n. 

Often we omit the mention of D,, = N (since it is known) and give only the 
range D!,. Thus instead of (1), we briefly write 


DAG ira BI cr 


or, more generally, 


Uj, U2, +--+, Un, ---- 


Yet it should be remembered that u is a set of pairs (a map). 

If all u, are distinct (different from each other), u is a one-to-one map. How- 
ever, this need not be the case. It may even occur that all u, are equal (then u 
is said to be constant); e.g., Un = 1 yields the sequence 1, 1,1, ...,1,..., ie, 


L623 see OR ace 
v= (3 he aoe: oy, 2) 
Note that here wu is an infinite sequence (since D, = N), even though its 
range Di, has only one element, D/, = {1}. (In sets, repeated terms count 
as one element; but the sequence u consists of infinitely many distinct pairs 


(n, 1).) Ifall u, are real numbers, we call u a real sequence. For such sequences, 
we have the following definitions. 


? However, such a formula may not exist; the uy may even be chosen “at random.” 
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Definition 1. 


A real sequence {u,,} is said to be monotone (or monotonic) iff it is either 
nondecreasing, i.€., 
(VR) Un S Uneas 


or nonincreasing, 1.€., 
(Vn) Wy & asd 


Notation: {u,}t and {u,}J, respectively. If instead we have the strict 
inequalities un < Un+1 (respectively, un > Un4i), we call {u,} strictly 
monotone (increasing or decreasing). 


A similar definition applies to sequences of sets. 
Definition 2. 


A sequence of sets A;, Ao,..., An, ... is said to be monotone iff it is 
either expanding, i.e., 


(Vn) An ‘Se Agsiy 


or contracting, i.e., 


(Vn) An > An-+1- 


Notation: {A,}t and {A,,}J, respectively. For example, any sequence of 
concentric solid spheres (treated as sets of points), with increasing radii, 
is expanding; if the radii decrease, we obtain a contracting sequence. 


Definition 3. 


Let {u,} be any sequence, and let 
Ny <SNg Set ONE <eee 


be a strictly increasing sequence of natural numbers. Select from {u,} 
those terms whose subscripts are n1, N2, ..., Ne, .... Then the sequence 
{Un, + so selected (with kth term equal to un,), is called the subsequence 
of {u,}, determined by the subscripts nz, k = 1, 2, 3,.... 


Thus (roughly) a subsequence is any sequence obtained from {u,,} by drop- 
ping some terms, without changing the order of the remaining terms (this is 
ensured by the inequalities ny < ng <--- < np <--- where the nz are the 
subscripts of the remaining terms). For example, let us select from (1) the 
subsequence of terms whose subscripts are primes (including 1). Then the 
subsequence is 

2,4, 6, 10, 14, 22,..., 


1.8.5 
U1, U2, UZ, U5, U7, U11,---- 
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All these definitions apply to finite sequences accordingly. Observe that 
every sequence arises by “numbering” the elements of its range (the terms): u4 
is the first term, uz is the second term, and so on. By so numbering, we put 
the terms in a certain order, determined by their subscripts 1, 2, 3,... (like 
the numbering of buildings in a street, of books in a library, etc.). The question 
now arises: Given a set A, is it always possible to “number” its elements by 
integers? As we shall see in 89, this is not always the case. This leads us to 
the following definition. 


Definition 4. 


A set A is said to be countable iff A is contained in the range of some 
sequence (briefly, the elements of A can be put in a sequence). 

If, in particular, this sequence can be chosen finite, we call A a finite 
set. (The empty set is finite.) 

Sets that are not finite are said to be infinite. 

Sets that are not countable are said to be uncountable. 


Note that all finite sets are countable. The simplest example of an infinite 
countable set is N = {1, 2, 3, ...}. 


§9. Some Theorems on Countable Sets! 


We now derive some corollaries of Definition 4 in 88. 
Corollary 1. If a set A is countable or finite, so is any subset B C A. 
For if A C Di, for a sequence wu, then certainly BC AC D'. 
Corollary 2. If A is uncountable (or just infinite), so is any superset B D A. 
For, if B were countable or finite, so would be A C B, by Corollary 1. 
Theorem 1. Jf A and B are countable, so is their cross product A x B. 


Proof. If A or B is @, then A x B = @, and there is nothing to prove. 

Thus let A and B be nonvoid and countable. We may assume that they fill 
two infinite sequences, A = {a,,}, B = {b,,} (repeat terms if necessary). Then, 
by definition, A x B is the set of all ordered pairs of the form 


(an, bm), n,meEN. 


Call n+™m the rank of the pair (an, bm). For each r € N, there are r — 1 pairs 
of rank r: 


(a4, Dead) (ao, b=), eine (a,-—1, bi). (1) 


1 This section may be deferred until Chapter 5, §4. 
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We now put all pairs (a, bm) in one sequence as follows. We start with 
(a1, b1) 
as the first term; then take the two pairs of rank three, 
(a1, bg), (a2, b1); 


then the three pairs of rank four, and so on. At the (r — 1)st step, we take all 
pairs of rank r, in the order indicated in (1). 
Repeating this process for all ranks ad infinitum, we obtain the sequence of 
pairs 
(a1, b1), (a1, b2), (a2, 61), (a1, 63), (a2, b2), (a3, b1), .--, 
in which Ut= (a1, bi), U2 = (a1, bz), etc. 
By construction, this sequence contains all pairs of all ranks r, hence all pairs 


that form the set A x B (for every such pair has some rank r and so it must 
eventually occur in the sequence). Thus A x B can be put in a sequence. 


Corollary 3. The set R of all rational numbers? is countable. 


Proof. Consider first the set Q of all positive rationals, i.e., 


. n : 
fractions —, with n,m Ee N. 
m 


We may formally identify them with ordered pairs (n, m), i.e., with N x N. 

We call n +m the rank of (n, m). As in Theorem 1, we obtain the sequence 
11232: 2 23 12 3 4 
PPpyepryrvypyp Rp 

By dropping reducible fractions and inserting also 0 and the negative rationals, 

we put FR into the sequence 


1 
0, 1, -1, ah a 2, —2, ~, —-, 3, —3, ..., asrequired. UO 


Theorem 2. The union of any sequence {A,,} of countable sets is countable. 


Proof. As each A, is countable, we may put 
Aig {Gps Citic n« ke, Oona wn be 


(The double subscripts are to distinguish the sequences representing different 
sets A,,.) As before, we may assume that all sequences are infinite. Now, U,, An 
obviously consists of the elements of all A, combined, i.e., all nm (n,m € N). 
We callin +m the rank of ay, and proceed as in Theorem 1, thus obtaining 


(J An = {d11, G12, 421, 413, 422, @31, ...}. 


n 


2 A number is rational iff it is the ratio of two integers, p/q, q 4 0. 
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Thus U),, An can be put in a sequence. O 
Note 1. Theorem 2 is briefly expressed as 
“Any countable union of countable sets is a countable set.” 


(The term“ countable union” means “union of a countable family of sets”, i.e., a 
family of sets whose elements can be put in a sequence {A,,}.) In particular, 
if A and B are countable, so are AUB, AN B, and A — B (by Corollary 1). 

Note 2. From the proof it also follows that the range of any double se- 
quence {Qnm} is countable. (A double sequence is a function wu whose domain 
Dy is N x N; say, u: Nx N > B. If n,m € N, we write unm for u(n, m); 
Here tum = Gans) 

To prove the existence of uncountable sets, we shall now show that the 
interval 

[Ost oe | Oe <1} 


of the real axis is uncountable. 
We assume as known the fact that each real number z € [0, 1) has a unique 
infinite decimal expansion 


0.01, T2,.--, Un,---, 


where the x, are the decimal digits (possibly zeros), and the sequence {xp} 
does not terminate in nines (this ensures uniqueness).® 


Theorem 3. The interval (0, 1) of the real axis is uncountable. 


Proof. We must show that no sequence can comprise all of [0, 1). Indeed, 
given any {u,,}, write each term u, as an infinite decimal fraction; say, 


Un = 0.Gn1, An2,---; nm, ---- 
Next, construct a new decimal fraction 
Fa Oe ra ae Ho ee be 


choosing its digits x, as follows. 
If Qnn (i-e., the nth digit of un) is 0, put x, = 1; if, however, ann # 0, put 
Ly, = 0. Thus, in all cases, t, ~ Ann, ie., z differs from each un in at least one 
decimal digit (namely, the nth digit). It follows that z is different from all uy, 
and hence is not in {u,}, even though z € (0, 1). 
Thus, no matter what the choice of {u,} was, we found some z € [0, 1) not 
in the range of that sequence. Hence no {u,,} contains all of [0, 1). O 


Note 3. By Corollary 2, any superset of |0, 1), e.g., the entire real axis, is 
uncountable. See also Problem 4 below. 


3 For example, instead of 0.49999 ..., we write 0.50000.... 
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Note 4. Observe that the numbers a,,,, used in the proof of Theorem 3 form 
the diagonal of the infinitely extending square composed of all ay. Therefore, 
the method used above is called the diagonal process (due to G. Cantor). 


i. 


“Gs 


Problems on Countable and Uncountable Sets 


Prove that if A is countable but B is not, then B— A is uncountable. 
[Hint: If B — A were countable, so would be 


(B—A)UADB. (Why?) 


Use Corollary 1.] 


. Let f be a mapping, and A C Dy. Prove that 


(i) if A is countable, so is f[A]; 
(ii) if f is one to one and A is uncountable, so is f[A]. 
[Hints: (i) If A = {un}, then 
FIA] = {f(ur1), F(ua), +++, Fun), +++ F- 
(ii) If f[A] were countable, so would be f~1[f[Al], by (i). Verify that 
f*[f[A]] = A 
here; cf. Problem 7 in §§4-7]] 


. Let a, 6 be real numbers (a < 6). Define a map f on [0, 1) by 


f(z) =a4+2(b—-a). 


Show that f is one to one and onto the interval |a, b) = {«|a <a < bd}. 
From Problem 2, deduce that [a, 6) is uncountable. Hence, by Problem 
1, sors (6, ) =e |e <a SO}. 


. Show that between any real numbers a, b (a < b) there are uncountably 


many irrationals, i.c., numbers that are not rational. 
[Hint: By Corollary 3 and Problems 1 and 3, the set (a, b) — R is uncountable. 
Explain in detail.] 


. Show that every infinite set A contains a countably infinite set, i.e., an 


infinite sequence of distinct terms. 


[Hint: Fix any a1 € A; A cannot consist of a1 alone, so there is another element 
a2 € A— {ai}. (Why?) 


Again, A # {a1, a2}, so there is an a3 € A — {a1, a2}. (Why?) Continue thusly ad 
infinitum to obtain the required sequence {an}. Why are all ay distinct’| 


From Problem 5, prove that if A is infinite, there isa map f: A > A 
that is one to one but not onto A. 


[Hint: With a, as in Problem 5, define f(an) = an+1. If, however, x is none of the 
Qn, put f(x) = a. Observe that f(x) = a, is never true, so f is not onto A. Show, 
however, that f is one to one.| 
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*7. Conversely (cf. Problem 6), prove that if there is a map f: A — A that 
is one to one but not onto A, then A contains an infinite sequence {a,, } 
of distinct terms. 

[Hint: As f is not onto A, there is ay € A such that a; ¢ f[A]. (Why?) Fix a, and 


define 
a2 = f(a1), a3 = f(a2), ..., @n41 = f(an), ... ad infinitum. 


To prove distinctness, show that each ay, is distinct from all am with m > n. For aj, 
this is true since a; ¢ f[A], whereas am € f[A] (m > 1). Then proceed inductively.] 


Chapter 2 
Real Numbers. Fields 


§§1—4. Axioms and Basic Definitions 


Real numbers can be constructed step by step: first the integers, then the 
rationals, and finally the irrationals.' Here, however, we shall assume the 
set of all real numbers, denoted E', as already given, without attempting to 
reduce this notion to simpler concepts. We shall also accept without definition 
(as primitive concepts) the notions of the sum (a+ b) and the product, (a- b) 
or (ab), of two real numbers, as well as the inequality relation < (read “less 
than”). Note that x € E} means “sx is in E},” i.e., “x is a real number.” 

It is an important fact that all arithmetic properties of reals can be deduced 
from several simple axioms, listed (and named) below. 


AXIOMS OF ADDITION AND MULTIPLICATION 


I (closure laws). The sum x+y, and the product xy, of any real numbers 
are real numbers themselves. In symbols, 


(Vz,yeE') (ex+y)€ E' and (zy) € E'. 
II (commutative laws). 
(V2,yeER') «+y=y+2 and zy = yz. 
III (associative laws). 
(Va,y,z2€E') (x+y)+z2=24(y4+2z) and (ry)z = x(yz). 


IV (existence of neutral elements). 


(a) There is a (unique) real number, called zero (0), such that, for all 
realx, c+0=2. 


1 See the author’s Basic Concepts of Mathematics, Chapter 2, §15. 
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(b) There is a (unique) real number, called one (1), such that 1 4 0 
and, for all realx, x-1l=«a. 


In symbols, 
(a) (l0e BE) V2e Ek) £4+0=2; 
(b) (Alle BE’) (Vere E') x-l=2,1F0. 


(The real numbers 0 and 1 are called the neutral elements of addition and 
multiplication, respectively. ) 


(existence of inverse elements). 
(a) For every real x, there is a (unique) real, denoted —x, such that 
x+(—x)=0. 
(b) For every real x other than 0, there is a (unique) real, denoted x~', 
such that x-x-1=1. 
In symbols, 
(a) (V2 € E?) (al-xve E') x+(-2x)=0; 
(b) (V2 eH" |¢40) Gla tek) set =1. 
(The real numbers —a and 2! are called, respectively, the additive in- 


verse (or the symmetric) and the multiplicative inverse (or the reciprocal) 
of x.) 


(distributive law). 


(Va,y,z€E) (@t+y)z=2z+4+ yz. 


AXIOMS OF ORDER 


(trichotomy). For any real x and y, we have 
elher 2 <y ory <2 org =y 
but never two of these relations together. 
(transitivity). 
(Va,y,2€E') x<y andy <z implies x < z. 


(monotonicity of addition and multiplication). For any x, y, z € E+, we 
have 

(a) c<y impliesx+z<yt2; 

(b) x < y and z >0 implies xz < yz. 


An additional axiom will be stated in §88-9. 
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Note 1. The uniqueness assertions in Axioms IV and V are actually re- 
dundant since they can be deduced from other axioms. We shall not dwell on 
this. 


Note 2. Zero has no reciprocal; i.e., for no x is Ox = 1. In fact, Ox = 0. 
For, by Axioms VI and IV, 


Ox + Or = (0+ 0)a = Ox = Ox + 0. 


Cancelling Oz (i.e., adding —Oz on both sides), we obtain 0x = 0, by Axioms III 
and V(a). 


Note 3. Due to Axioms VII and VIII, real numbers may be regarded as 
given in a certain order under which smaller numbers precede the larger ones. 
(This is why we speak of “axioms of order.” ) The ordering of real numbers can 
be visualized by “plotting” them as points on a directed line (“the real axis” ) 
in a well-known manner. Therefore, E' is also often called “the real axis,” and 
real numbers are called “points”; we say “the point x” instead of “the number 
a” 

Observe that the axioms only state certain properties of real numbers without 
specifying what these numbers are. Thus we may treat the reals as just any 
mathematical objects satisfying our axioms, but otherwise arbitrary. Indeed, 
our theory also applies to any other set of objects (numbers or not), provided 
they satisfy our axioms with respect to a certain relation of order (<) and 
certain operations (+) and (-), which may, but need not, be ordinary addition 
and multiplication. Such sets exist indeed. We now give them a name. 


Definition 1. 
A field is any set F of objects, with two operations (+) and (-) defined 
in it in such a manner that they satisfy Axioms I-VI listed above (with 
E' replaced by F’, of course). 


If F' is also endowed with a relation < satisfying Axioms VII to IX, we 
call F' an ordered field. 


In this connection, postulates I to IX are called axioms of an (ordered) field. 

By Definition 1, E! is an ordered field. Clearly, whatever follows from the 
axioms must hold not only in E! but also in any other ordered field. Thus 
we shall henceforth state our definitions and theorems in a more general way, 
speaking of ordered fields in general instead of E! alone. 


Definition 2. 


An element x of an ordered field is said to be positive if x > 0 or negative 
ifx <0. 

Here and below, “x > y” means the same as “y < x.” We also write 
“e <y” for “xs < y or x= y”; similarly for “x > y.” 
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Definition 3. 


For any elements x, y of a field, we define their difference 
t—y=x+ (-y). 
If y 4 0, we also define the quotient of x by y 


also denoted by x/y. 


Note 4. Division by 0 remains undefined. 
Definition 4. 


For any element x of an ordered field, we define its absolute value, 
e { x if x > 0 and 
— 
—x ifa<Q0. 
It follows that |x| > 0 always; for if x > 0, then 
eo =U: 


and if x < 0, then 
|z| = —2 >0. (Why?) 


Moreover, 
—|z| <x < |e, 
for, 
ie 0, ihe |e) = 2: 
and 


if z < 0, then x < |2| since |x| > 0. 
Thus, in all cases, 
os |G. 
Similarly one shows that 


—|r| <a. 


As we have noted, all rules of arithmetic (dealing with the four arithmetic 
operations and inequalities) can be deduced from Axioms I through IX and 
thus apply to all ordered fields, along with E'. We shall not dwell on their 
deduction, limiting ourselves to a few simple corollaries as examples.” 


* For more examples, see the author’s Basic Concepts of Mathematics, Chapter 2, §§3-4. 
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Corollary 1 (rule of signs). 
(i) a(—b) = (—a)b = —(ab); 
(ii) (—a)(—b) = ab. 
Proof. By Axiom VI, 
a(—b) + ab = al|(—b) + b] =a-0=0. 


Thus 
a(—b) + ab = 0. 
By definition, then, a(—b) is the additive inverse of ab, i.e., 
a(—b) = —(ab). 
Similarly, we show that 
(—a)b = —(ab) 


and that 
—(—a) =a. 


Finally, (ii) is obtained from (i) when a is replaced by —a. 


Corollary 2. In an ordered field, a 4 0 implies 
a” = (a-a)>0. 
(Hence 1 = 17 > 0.) 
Proof. If a > 0, we may multiply by a (Axiom IX(b)) to obtain 
a-a>0-a=0,ie., a? >0. 
If a < 0, then —a > 0; so we may multiply the inequality a < 0 by —a and 


obtain 
a(—a) < 0(—a) = 0; 


i.e., by Corollary 1, 
a 2 0, 


whence 


§85-6. Natural Numbers. Induction 


The element 1 was introduced in Axiom IV(b). Since addition is also assumed 
known, we can use it to define, step by step, the elements 


2=141, 3=241, 4=341, etc. 
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If this process is continued indefinitely, we obtain what is called the set N of 
all natural elements in the given field F’. In particular, the natural elements of 
E! are called natural numbers. Note that 


(VnEN) n+1eENn. 
*A more precise approach to natural elements is as follows.' A subset S of 

a field F' is said to be inductive iff 

(i) 1 eS and 

(ii) Vee S)r+1€S8. 
Such subsets certainly exist; e.g., the entire field F’ is inductive since 

le Fand (Vie F)r+1eF. 

Define N as the intersection of all inductive sets in F’. 


*Theorem 1. The set N so defined is inductive itself. In fact, it is the “small- 
est” inductive subset of F' (1.e., contained in any other such subset). 
Proof. We have to show that 

(i) 1 € N, and 

(ii) VaEeN)at+1eEN. 
Now, by definition, the unity 1 is in each inductive set; hence it also belongs 
to the intersection of such sets, i.e., to N. Thus 1 € N, as claimed. 

Next, take any x € N. Then, by our definition of N, x is in each inductive 


set S; thus, by property (ii) of such sets, also x + 1 is in each such S$; hence 
x +1 is in the intersection of all inductive sets, i.e., 


rt1leN, 


and so WN is inductive, indeed. 


Finally, by definition, N is the common part of all such sets and hence 
contained in each. 


For applications, Theorem 1 is usually expressed as follows. 


Theorem 1’ (first induction law). A proposition P(n) involving a natural n 
holds for alln € N ina field F if 


(i) it holds for n =1, t.e., P(1) is true; and 
(ii) whenever P(n) holds for n =m, it holds forn =m +1, i.e., 


P(m) => P(m +1). 


1 At a first reading, one may omit all “starred” passages and simply assume Theorems 1’ 
and 2’ below as additional axioms, without proof. 
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*Proof. Let S be the set of all those n € N for which P(n) is true, 
S={neN | P(n)}. 


We have to show that actually each n € N is in S,i.e., NCS. 

First, we show that S' is inductive. 

Indeed, by assumption (i), P(1) is true; so 1 € S. 

Next, let z € S. This means that P(x) is true. By assumption (ii), however, 
this implies P(x + 1), i.e., 2 +1¢ 5. Thus 


le Sand (VaeES)r£+1€S8; 


S is inductive. 
Then, by Theorem 1 (second clause), N C S, and all is proved. O 


This theorem is used to prove various properties of N “by induction.” 
Examples. 


(a) Ifm, n€ N, then alsom+neN andmne N. 
To prove the first property, fix any m € N. Let P(n) mean 


m+neEeN (neN). 


Then 


(i) P(1) is true, for as m € N, the definition of N yields m+1 € N, 
Weng FL). 


(ii) P(k) > P(k+1) fork € N. Indeed, 
P(k) > m+keN>(m+k)+1EN 
>m+(k+1)EeN=> P(k+1). 
Thus, by Theorem 1’, P(n) holds for all n; i.e., 
(VneN) m+neNn 


for any m € N. 
To prove the same for mn, we let P(n) mean 


mneN (neN) 


and proceed similarly. 


(b) Ifne N, thenn—-—1=0 orn—-1eEN. 
For an inductive proof, let P(n) mean 


n—-1=Oorn-1EN (nEN). 


Then proceed as in (a). 
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(c) In an ordered field, all naturals are > 1. 
Indeed, let P(n) mean that 


n>1 (neN). 
Then 
(i) P(1) holds since 1 = 1. 
(ii) P(m) > P(m+ 1) for m € N, since 
Pim) S>m2>1S> (m+1)>1>Pm+1). 


Thus Theorem 1’ yields the result. 
(d) In an ordered field, m,n € N andm>n impliesm—neN. 
For an inductive proof, fix any m € N and let P(n) mean 
m—-n<Oorm—neEN (nEN). 
Use (b). 
(e) In an ordered field, m,n € N andm<n-+1 impliesm <n. 


For, by (d), m > n would imply m—n € N, hence m — n > 1, or 
m>n+1, contrary tom<n+1. 


Our next theorem states the so-called well-ordering property of N. 


Theorem 2 (well-ordering of N). In an ordered field, each nonvoid set A C N 
has a least member (i.e., one that exceeds no other element of A). 


Proof outline.?, Given @ 4 A CN, let P(n) be the proposition “Any subset 
of A containing elements < n has a least member” (n € N). Use Theorem 1’ 
and Example (e). 


This theorem yields a new form of the induction law. 
Theorem 2’ (second induction law). A proposition P(n) holds for alln € N 
in an ordered field if 
(i’) P(1) holds and 


(ii’) whenever P(n) holds for all naturals less than some m € N, then P(n) 
also holds forn =m. 


Proof. Assume (i’) and (ii’). Seeking a contradiction,? suppose there are some 
n € N (call them “bad” ) for which P(n) fails. Then these “bad” naturals form 
a nonvoid subset of N, call it A. 


? For a more detailed proof, see Basic Concepts of Mathematics, Chapter 2, §5, Theorem 2. 
3We are using a “proof by contradiction” or “indirect proof.” Instead of proving our 
assertion directly, we show that the opposite is impossible, being contradictory. 
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By Theorem 2, A has a least member m. Thus m is the least natural for 
which P(n) fails. It follows that all n less than m do satisfy P(n). But then, 
by our assumption (ii’), P(n) also holds for n = m, which is impossible for, by 
construction, m is “bad” (it is in A). This contradiction shows that there are 
no “bad” naturals. Thus all is proved. O 


Note 1. All the preceding arguments hold also if, in our definition of N 
and all formulations, the unity 1 is replaced by 0 or by some k (+k € N). 
Then, however, the conclusions must be changed to say that P(n) holds for all 
integers n > k (instead of “n > 1”). We then say that “induction starts with 
k.” 

An analogous induction law also applies to definitions of concepts C(n). 

A notion C(n) involving a natural n is regarded as defined for eachn € N 
(in E+) if 

(i) it is defined forn = 1 and 

(ii) some rule is given that expresses C(n +1) in terms of C(1),..., C(n). 


(Note 1 applies here, too.) 

C(n) itself need not be a number; it may be of quite general nature. 

We shall adopt this principle as a kind of logical axiom, without proof 
(though it can be proved in a similar manner as Theorems 1’ and 2’). The un- 
derlying intuitive idea is a “step-by-step” process—first, we define C'(1); then, 
as C'(1) is known, we may use it to define C(2); next, once both are known, 
we may use them to define C(3); and so on, ad infinitum. Definitions based 
on that principle are called inductive or recursive. The following examples are 
important. 


Examples (continued). 


(f) For any element zx of a field, we define its nth power x” and its n-multiple 
na by 


fi) g2=le=z; 
(ii) et! = x" zx (respectively, (n+ 1)z =nz+2). 
We may think of it as a step-by-step definition: 
gi = x, ge? = xa, p= x72, etc. 
(g) For each natural number n, we define its factorial n! by 


W=1, (n+1ll=n!(n4+ 1); 


e.g., 2! = 1!(2) = 2, 3! = 2! (3) = 6, etc. We also define 0! = 1. 
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(h) The sum and product of n field elements x1, £2, ..., L,, denoted by 


nm n 
ys and I] Lr 
k=1 k=1 
or 
ty +%o+---+2%y and 112%2---Xn, respectively, 


are defined recursively. 
Sums are defined by 


1 
a). ) oxi 
k=1 
n+1 n 
(ii) a: = (Sox) + By bi, t= 1, Dy aas 
k=1 


k=1 


Thus 
a te te = (ee) oe, 


M+%2+%34+%4 = (a1 + 22 +23) +24, etc. 


Products are defined by 


1 
(i) I] Te = 015 
k=1 


n+1 n 
(ii) I] Lk = ( vn) *Int+1- 
k=1 k=1 


(i) Given any objects 11, ©2,..., Ln, ..., the ordered n-tuple 


(x1, LY, eee aie) 
is defined inductively by 


(i) (@1,) = x (i.e., the ordered “one-tuple” (x1) is x1 itself) and 


(ii) (@1, Va, .--, Engi) = ((41, ---, Ln), Ln41), ie., the ordered (n+1)- 
tuple is a pair (y, Zn41) in which the first term y is itself an ordered 
n-tuple, (11, ..., Zn); for example, 


(21, Z2, X3) = ((41, Lo), 3), etc. 


Problems on Natural Numbers and Induction 
1. Complete the missing details in Examples (a), (b), and (d). 


2. Prove Theorem 2 in detail. 
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3. Suppose x, < yx, kK = 1, 2, ..., in an ordered field. Prove by induction 
on n that 


(a) Sore < So ye; 
k=1 k=1 


(b) if all x,, yx are greater than zero, then 
I] Lke< I] Uk- 
k=1 k=1 


4. Prove by induction that 
(i) 1" =1; 
(ii) a<bSa" <b" ifa>0. 
Hence deduce that 
(iii) O< a" <1if0<a<1; 
(iv) a” <b” >a < b if b > 0; proof by contradiction. 
5. Prove the Bernoulli inequalities: For any element ¢ of an ordered field, 
(i) (1+e)" >1+ne ife > -1; 
(ii) =e)" >1—ne tie < 13 n=1, 2, 3,2... 


6. For any field elements a, 6 and natural numbers m, n, prove that 


(i) aa" =a"; (ii) (a")"=a™™; 
Git) .@¢b)"=a"b"s (iv) (m+n)a=ma+na; 
(v) n(ma) = (nm) - a; (vi) n(a+b)=na+nb. 


[Hint: For problems involving two natural numbers, fix m and use induction on n]. 


7. Prove that in any field, 
ge Saher, pl, o, By ask 
k=0 


Hence for r £ 1 
se ike 


nm 

y ar® = qa ———— 
l-r 

k=0 


(sum of n terms of a geometric series). 


8. For n > 0 define 


0, otherwise. 
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(5 ~ (;) ° (1) 


Then prove by induction on n that 


Verify Pascal’s law, 


k 


(ii) for any field elements a and 6), 


(i) (Vk|O<k<n) (7) € N; and 


(a+b)” = » (") a’b”—*, nm €N (the binomial theorem). 
k=0 


What value must 0° take for (ii) to hold for all a and b? 


9. Show by induction that in an ordered field F' any finite sequence 
1,---, 2%, has a largest and a least term (which need not be x1 or 
Xn). Deduce that all of N is an infinite set, in any ordered field. 


10. Prove im E! ra 


ope k= —-n(n+1); 
(ii) S k? = + 1)(2n +1); 
(ii) } k= 7 44: 


(iv) b= ann + 1)(2n +1)(8n? + 3n — 1). 


§7. Integers and Rationals 


All natural elements of a field F', their additive inverses, and 0 are called the 
integral elements of F’, briefly integers. 

An element x € F is said to be rational iff x = . for some integers p and q 
(¢q #0); x is irrational iff it is not rational. 

We denote by J the set of all integers, and by R the set of all rationals, in 
F. Every integer p is also a rational since p can be written as p/q with q = 1. 
Thus 

RDIIDN. 
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In an ordered field, 
N={xeEJ|a> 0}. (Why?) 
Theorem 1. /f a and b are integers (or rationals) in F, so are a+ b and ab. 


Proof. For integers, this follows from Examples (a) and (d) in §§5—6; one only 
has to distinguish three cases: 


(i) a,bEN; 
(ii) -aeN,bEN; 
(iii) ae N, -bEN. 
The details are left to the reader (see Basic Concepts of Mathematics, Chap- 


ter 2, §7, Theorem 1). 
Now let a and 0 be rationals, say, 


- 
i= wdb=—, 
s 


where p, qg, 7, s€ J and q, s #0. Then, as is easily seen, 


staqr r 
— and ab = =. 
qs 


atb= 


where gs # 0; and qs and pr are integers by the first part of the proof (since 
P,4,7,5€d). 

Thus a+0 and ab are fractions with integral numerators and denominators. 
Hence, by definition, a+b€ Randabe R. OU 


Theorem 2. In any field F’, the set R of all rationals is a field itself, under 
the operations defined in F,, with the same neutral elements 0 and 1. Moreover, 
R is an ordered field if F is. (We call R the rational subfield of F.) 


Proof. We have to check that R satisfies the field axioms. 

The closure law I follows from Theorem 1. 

Axioms II, III, and VI hold for rationals because they hold for all elements 
of F’; similarly for Axioms VII to IX if F' is ordered. 

Axiom IV holds in R because the neutral elements 0 and 1 belong to R; 
indeed, they are integers, hence certainly rationals. 

To verify Axiom V, we must show that —x and x~! belong to R if x does. 
If, however, 


ae (p,q e J, ¢#0), 


then 
_ —?p 
a — 
q 


where again —p € J by the definition of J; thus —x € R. 
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If, in addition, « 4 0, then p 4 0, and 


gos implies 2~! = 
q 


. (Why?) 


SIR 


Thusz!eR. O 


Note. The representation 
Dp 
oF (p,q € J) 


is not unique in general; in an ordered field, however, we can always choose 
q>0,i., qe WN (take p< Oif x <0). 

Among all such q there is a least one by Theorem 2 of §85-6. If x = p/q, 
with this minimal q € N, we say that the rational x is given in lowest terms. 


§§8-9. Upper and Lower Bounds. Completeness Axiom 


A subset A of an ordered field F' is said to be bounded below (or left bounded) 
iff there is p € F' such that 


(VaEA) p<a; 
A is bounded above (or right bounded) iff there is q € F' such that 
(VaeEA) xq. 


In this case, p and q are called, respectively, a lower (or left) bound and an 
upper (or right) bound, of A. If both exist, we simply say that A is bounded 
(by p and q). The empty set @) is regarded as (“vacuously” ) bounded by any p 
and q (cf. the end of Chapter 1, §3). 

The bounds p and q may, but need not, belong to A. If a left bound p 
is itself in A, we call it the least element or minimum of A, denoted min A. 
Similarly, if A contains an upper bound q, we write g = max A and call q the 
largest element or maximum of A. However, A may well have no minimum or 
maximum. 


Note 1. A finite set A 4 @ always has a minimum and a maximum 
(see Problem 9 of §85-6). 


Note 2. A set A can have at most one maximum and at most one minimum. 
For if it had two maxima q, q’, then 


q<q 
(since gq € A and q’ is a right bound); similarly 


qd <q; 
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so g = q’ after all. Uniqueness of min A is proved in the same manner. 
Note 3. If A has one lower bound p, it has many (e.g., take any p’ < p). 
Similarly, if A has one upper bound q, it has many (take any q' > q). 
Geometrically, on the real axis, all lower (upper) bounds lie to the left (right) 
of A; see Figure 1. 


/ A / 
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FIGURE 1 
Examples. 
(1) Let 
A= {i, -2, 7}. 


Then A is bounded above (e.g., by 7, 8, 10,...) and below (e.g., by 
25, 25, 12, inc), 
We have min A = —2, max A = 7. 


(2) The set N of all naturals is bounded below (e.g., by 1, 0, 5, —1,...), 


and 1 = min N; N has no maximum, for each gq € N is exceeded by some 
neéEN (eg.,n=qt1). 
(3) Given a, b € F (a < b), we define in F' the open interval 
(= 49 |a< a <b}: 
the closed interval 
io = {elon e< bh 
the half-open interval 
(@, O| 1a |a< ae = op 
and the half-closed interval 
ie =4e as ea b 


Clearly, each of these intervals is bounded by the endpoints a and b; 
moreover, a € [a, b] and a € [a, b) (the latter provided [a, b) £0, i.e., a < 


b), and a = minja, b] = minia, b); similarly, b = max[a, b] = max(a, 9]. 
But [a, b) has no maximum, (a, b] has no minimum, and (a, b) has neither. 
(Why) 


Geometrically, it seems plausible that among all left and right bounds of A 
(if any) there are some “ closest” to A, such as u and v in Figure 1, i.e., a least 
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upper bound v and a greatest lower bound u. These are abbreviated 
lub A and glb A 
and are also called the supremum and infimum of A, respectively; briefly, 
v = sup A, u = inf A. 


However, this assertion, though valid in E', fails to materialize in many 
other fields such as the field R of all rationals (cf. §§11-12). Even for E', it 
cannot be proved from Axioms I through IX. 

On the other hand, this property is of utmost importance for mathematical 
analysis; so we introduce it as an aziom (for E'), called the completeness 
axiom. It is convenient first to give a general definition. 


Definition 1. 
An ordered field F' is said to be complete iff every nonvoid right-bounded 
subset A C F has a supremum (i.e., a lub) in F’. 
Note that we use the term “complete” only for ordered fields. 


With this definition, we can give the tenth and final axiom for E!. 
X (completeness axiom). The real field E‘ is complete in the above sense. 


That is, each right-bounded set A C E* has a supremum (sup A) in E}, 
provided A # 0. 


The corresponding assertion for infima can now be proved as a theorem. 


Theorem 1. Jn a complete field F (such as E+), every nonvoid left-bounded 
subset A C F has an infimum (i.e., a glb). 


Proof. Let B be the (nonvoid) set of all lower bounds of A (such bounds exist 
since A is left bounded). Then, clearly, no member of B exceeds any member 
of A, and so B is right bounded by an element of A. Hence, by the assumed 
completeness of F', B has a supremum in F, call it p. 

We shall show that p is also the required infimum of A, thus completing the 
proof. 

Indeed, we have 

(i) p is a lower bound of A. For, by definition, p is the least upper bound of 

B. But, as shown above, each x € A is an upper bound of B. Thus 


(VaE A) p<a. 


(ii) p is the greatest lower bound of A. For p = sup B is not exceeded by any 
member of B. But, by definition, B contains all lower bounds of A; so p 
is not exceeded by any of them, i.e., 


p = glb A = inf A. 
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Note 4. The lub and glb of A (if they exist) are unique. For inf A is, 
by definition, the maximum of the set B of all lower bounds of A, and hence 
unique, by Note 2; similarly for the uniqueness of sup A. 


Note 5. Unlike min A and max A, the glb and lub of A need not belong to 
A. For example, if A is the interval (a, b) in E* (a < b) then, as is easily seen, 


a =inf A and b=sup4, 


though a,b ¢ A. Thus sup A and inf A may exist, though max A and min A do 
not. 


On the other hand, if 
q = max A (p= min A), 
then also 
q=sup A (p=inf A). (Why?) 
Theorem 2. Jn an ordered field F, we have q=supA (AC F) iff 
(i) (VaE A) ax<qand 
(ii) each field element p < q is exceeded by some x € A; 1.e., 


(Vp<q) (Gr€A) pKa. 
Equivalently, 
(ii’) (Ve >0) (Srn€A) q-ex<au;, (€ EF). 
Similarly, p = inf A iff 


(VaE A) p<a and (Ve>0) (AxE€A) pte>rds. 


Proof. Condition (i) states that q is an upper bound of A, while (ii) implies 
that no smaller element p is such a bound (since it is exceeded by some x in 
A). When combined, (i) and (ii) state that q is the least upper bound. 

Moreover, any element p < q can be written as qg—e (€ > 0). Hence (ii) can 
be rephrased as (ii’). 


The proof for inf A is quite analogous. 


Corollary 1. Let b € F and A C F in an ordered field F. If each element 
x of A satisfies x < b (x > b), so does supA (inf A, respectively), provided it 
exists in F’. 


In fact, the condition 
(VaEA) awd 


means that } is a right bound of A. However, sup A is the least right bound, 
so sup A < 0; similarly for inf A. 
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Corollary 2. In any ordered field, 0 4 A C B implies 
sup A < sup B and inf A > inf B, 


as well as 
inf A < sup A, 


provided the suprema and infima involved exist. 


Proof. Let p = inf B and q=sup B. 
As q is aright bound of B, 


x<qforallxe B. 
But A C B, so B contains all elements of A. Thus 
rEASreBarK<G 


so, by Corollary 1, also 
sup A < q=supB, 


as claimed. 
Similarly, one gets inf A > inf B. 
Finally, if A 4 0, we can fix some x € A. Then 


inf A<a2<supA, 


and all is proved. 


Problems on Upper and Lower Bounds 


. Fields 


1. Complete the proofs of Theorem 2 and Corollaries 1 and 2 for infima. 


Prove the last clause of Note 4. 


2. Prove that F' is complete iff each nonvoid left-bounded set in F’ has an 


infimum. 


3. Prove that if Ay, Ao, ..., Ay are right bounded (left bounded) in F’, so 


is 7 
LJ Ae. 
k=1 
4. Prove that if A = (a, b) is an open interval (a < b), then 
a = inf A and b= supA. 


5. In an ordered field F’, let 0A AC F. Let c € F and let cA denote the 


set of all products cx (x € A); ie., 
cA= {ex |e A}. 
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Prove that 
(i) ifc > 0, then 
sup(cA) = c- sup A and inf(cA) = c- inf A; 
(ii) if c < 0, then 
sup(cA) = c- inf A and inf(cA) =c- sup A. 
In both cases, assume that the right-side sup A (respectively, inf A) ex- 
ists. 


6. From Problem 5(ii) with c = —1, obtain a new proof of Theorem 1. 
[Hint: If A is left bounded, show that (—1)A is right bounded and use its supremum] 


7. Let A and B be subsets of an ordered field F. Assuming that the 
required lub and glb exist in F’, prove that 


(i) if V2 eA) (Vy Ee B)a<y, then supA < inf B; 
(ii) if Va Ee A) (Jy € B) ax<y, then supA < sup B; 
(iii) if (Vy € B) (Az € A) « < y, then inf A < inf B. 
[Hint for (i): By Corollary 1, (Vy € B) sup A < y, so sup A < inf B. (Why?)| 


8. For any two subsets A and B of an ordered field F’, let A + B denote 
the set of allsums x + y with x € A and y € B; i.e, 


A+B={e+y|r2eEA, y€ B}. 


Prove that if sup A = p and sup B = q exist in F’, then 
p+q=sup(A + 8B); 


similarly for infima. 
[Hint for sup: By Theorem 2, we must show that 
(i) (Va € A) (Vy € B) «+ y < p+q (which is easy) and 
(ii’) (Ve > 0) (A2€ A) (AYE B) et+y>(pt+q—e. 


Fix any ¢ > 0. By Theorem 2, 


(dae A) GyeEB) p—=<wandq~ = <y. (Why?) 
Then z : 
c+y> (p—=)+(a-5) =(p+4q)—€, 


as required.| 


9. In Problem 8 let A and B consist of positive elements only, and let 
AB={ay|xeEA, ye Bh. 
Prove that if sup A = p and sup B = q exist in F,, then 
pq = sup(AB); 


42 


10. 
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similarly for infima. 
[Hint: Use again Theorem 2(ii’). For sup(AB), take 
0<e<(p+q) min{p, q} 
and 


dys 2 
and y q- — 
p+q 


x> = 
Pp 
Pp q 
show t hat 


2 

é 
> = — ZT > Es 
TY > pq eC teege Pq—€E 


For inf(AB), let s = inf B and r = inf A; choose d < 1, with 


i242 — —, 

l+r+s 

Now take « € A and y € B with 
x<r+dandy<s4d, 


and show that 
ry <rTrst+e. 


Explain!] 

Prove that 
(i) if (Ve > 0) a> b—e, then a > b; 
(ii) if (Ve >0)a<b+e, thena<b. 


Prove the principle of nested intervals: If [an, b,| are closed intervals in 
a complete ordered field F’, with 


(Gir, bn] = [mats Dna4 | n= di, 2, weeg 


then 
CO 
lan, On] # 9. 
n=1 
[Hint: Let 
A = {a1, a2,..., Gn,..-}. 


Show that A is bounded above by each bn. 
Let p = sup A. (Does it exist?) 
Show that 
(Vn) an < p< bn, 


P € [an, bn]_] 
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12. Prove that each bounded set A 4 @ in a complete field F' is contained 
in a smallest closed interval [a, b| (so [a, 6] is contained in any other 
[c, d] D A). 
Show that this fails if “closed” is replaced by “open.” 
[Hint: Take a = inf A, b = sup Al]. 


13. Prove that if A consists of positive elements only, then qg = sup A iff 
(i) (Va € A) x <q and 
(ii) (Vd>1) (Gae€ A) q/d<z. 


[Hint: Use Theorem 2.] 


§10. Some Consequences of the Completeness Axiom 


The ancient Greek geometer and scientist Archimedes was first to observe that 
even a large distance y can be measured by a small yardstick x; one only has 
to mark « off sufficiently many times. Mathematically, this means that, given 
any x > 0 and any y, there is ann € N such that nz > y. This fact, known as 
the Archimedean property, holds not only in E' but also in many other ordered 
fields. Such fields are called Archimedean. In particular, we have the following 
theorem. 


Theorem 1. Any complete field F (e.g., E') is Archimedean.* 
That is, given any x, y € F (x > 0) in such a field, there is a natural n € F 
such that nx > y. 


Proof by contradiction. Suppose this fails. Thus, given y, x € F (x > 0), 
assume that there is non € N with nx > y. 
Then 
(VnEN) na<y; 


i.e., y is an upper bound of the set of all products nx (n € N). Let 
A={nz|neN}. 


Clearly, A is bounded above (by y) and A 4 Q; so, by the assumed com- 
pleteness of F', A has a supremum, say, g = sup A. 

As q is an upper bound, we have (by the definition of A) that nx < q for all 
n€N, hence also (n+ 1)a < qj ie., 


nxe<iq-2 


for aline N (sinceene N>n+1eEN). 


1 However, there also are incomplete Archimedean fields (see Note 2 in §§11-12). 
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Thus q— 2x (which is less than q for x > 0) is another upper bound of all nz, 
i.e., of the set A. 


This is impossible, however, since g = sup A is the least upper bound of A. 


This contradiction completes the proof. 


Corollary 1. In any Archimedean (hence also in any complete) field F’, the 
set N of all natural elements has no upper bounds, and the set J of all integers 
has neither upper nor lower bounds. Thus 


(VyEeF)AmneNn) -m<y<n. 
Proof. Given any y € F,, one can use the Archimedean property (with xz = 1) 
to find an n € N such that 
fie det Meas 1 Se 
Similarly, there is an m € N such that 
m>—y,1e., —m < y. 


This proves our last assertion and shows that no y € F' can be aright bound 
of N (for y<ne€WN), or a left bound of J (for y > —meJ). O 


Theorem 2. In any Archimedean (hence also in any complete) field F', each 
left (right) bounded set A of integers (0 # AC J) has a minimum (maximum, 
respectively). 
Proof. Suppose @ 4 A C J, and A has a lower bound y. 

Then Corollary 1 (last part) yields a natural m, with —m < y, so that 


(VaE A) -—-mM<a, 


and sox+m > 0. 
Thus, by adding m to each x € A, we obtain a set (call it A+m) of naturals.? 
Now, by Theorem 2 of 885-6, A +m has a minimum; call it p. As p is the 

least of all sums x +m, p—™ is the least of all x € A; so p—m = min A exists, 

as claimed. 
Next, let A have a right bound z. Then look at the set of all additive inverses 

—x of points x € A; call it B. 

Clearly, B is left bounded (by —z), so it has a minimum, say, u = min B. 

Then —u = max A. (Verify!) 


In particular, given any x € F (F Archimedean), let [x] denote the great- 
est integer < x (called the integral part of x). We thus obtain the following 
corollary. 


2 This is the main point—geometrically, we have “shifted” A to the right by m, so that 
its elements became positive integers: A+mC N. 
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Corollary 2. Any element x of an Archimedean field F has an integral part 
[x]. It is the unique integer n such that 


n<a<nt+l. 


(It exists, by Theorem 2.) 
Any ordered field has the so-called density property: 
If a < bin F, there is x € F such that a < x < b; e.g., take 


_ eae 
2 


We shall now show that, in Archimedean fields, x can be chosen rational, 
even if a and b are not. We refer to this as the density of rationals in an 
Archimedean field. 


Theorem 3 (density of rationals). Between any elements a and b (a < b) of 
an Archimedean field F (such as E+), there is a rational r € F with 


a<r<b. 


Proof. Let p = [a] (the integral part of a). The idea of the proof is to start 
with p and to mark off a small “yardstick” 


1 
—<b-a 
n 


several (m) times, until 
p+ ™ lands inside (a, b); 
n 


then r = p+ ™ is the desired rational. 
We now make it precise. As F’ is Archimedean, there are m,n € N such 
that 


n(b— a) > 1 and m(—) >a—p. 


We fix the least such m (it exists, by Theorem 2 in §§5-6). Then 


m—1 


m 
a—p<—, but <a-p 
n 
(by the minimality of m). Hence 
m 1 
a<p+—<a+—<a+(b—-a), 
n n 
since + < b—a. Setting 


m 
a ee, 
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we find 


a<r<at+b-a=b. O 


Note. Having found one rational 71, 
OS T= Dp, 
we can apply Theorem 3 to find another rg € R, 
ry <a <b, 
then a third rz € R, 
rg <73 <b, 


and so on. Continuing this process indefinitely, we obtain infinitely many 
rationals in (a, b). 


§§11-12. Powers With Arbitrary Real Exponents. Irrationals 


In complete fields, one can define a” for any a > 0 and r € E! (for r € N, see 
885-6, Example (f)). First of all, we have the following theorem. 


Theorem 1. Givena > 0 in a complete field F, and a natural number n € E, 
there always is a unique element p € F’, p> 0, such that 


n 


p =a, 
It is called the nth root of a, denoted 

Ya oral”, 
(Note that */a > 0, by definition.) 


A direct proof, from the completeness axiom, is sketched in Problems 1 and 
2 below. We shall give a simpler proof in Chapter 4, §9, Example (a). At 
present, we omit it and temporarily take Theorem 1 for granted. Hence we 
obtain the following result. 


Theorem 2. Every complete field F (such as E') has irrational elements, 
i.e., elements that are not rational. 
In particular, V2 is irrational. 


Proof. By Theorem 1, F’ has the element 
p = V2 with p? = 2. 


1 As usual, we write \/a for Ya. 
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Seeking a contradiction, suppose V2 is rational, i.e., 


V2=— 
n 
for some m, n € N in lowest terms (see §7, final note). 
Then m and n are not both even (otherwise, reduction by 2 would yield a 
smaller n). From m/n = V2, we obtain 


so m? is even. 


2 


Only even elements have even squares, however.* ‘Thus m itself must be 


even; i.e., m = 2r for some r € N. It follows that 
Ar? = m? = 2n?, ie., 2r? =n? 
and, by the same argument, n must be even. 
This contradicts the fact that m and n are not both even, and this contra- 
diction shows that \/2 must be irrational. O 


Note 1. Similarly, one can prove the irrationality of ,/a where a € N and 
a is not the square of a natural. See Problem 3 below for a hint. 


Note 2. Theorem 2 shows that the field R of all rationals is not com- 
plete (for it contains no irrationals), even though it is Archimedean (see Prob- 
lem 6). Thus the Archimedean property does not imply completeness (but see 
Theorem 1 of §10). 

Next, we define a” for any rational number r > 0. 

Definition 1. 


Given a > 0 in a complete field F’, and a rational number 


ee (m,nENCE’), 
n 


we define 
c= va" 
Here we must clarify two facts. 
(1) Ifn =1, we have 
a’ =a™ 1 = Yam =a™. 


2 For if m is odd, then m = 2q — 1 for some q € N, and hence 
m? = (2q— 1)? = 4q? — 4g +1=4q(q—1) +1 


is an odd number. 
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If m = 1, we get 


Thus Definition 1 agrees with our previous definitions of a” and (/a 
(m,neN). 


If r is written as a fraction in two different ways, 


then, as is easily seen, 
VO = <a = a" 


and so our definition is unambiguous (independent of the particular rep- 
resentation of r). 
Indeed, 


m 
Le implies mq = np, 
n q 


whence 
qm? = a, 


i.e., 
(at = (a?) 
cf. 885-6, Problem 6. 
By definition, however, 


(Ya™)” = a™ and (Va?)? = a?. 


Substituting this in (a)? = 


whence 
vam = VaP. 


Thus Definition 1 is valid, indeed. 


By using the results of Problems 4 and 6 of 885-6, the reader will easily 
obtain analogous formulas for powers with positive rational exponents, namely, 


aati = qr Cau = ar (ab)" = ab"; a” Po a® if 0 <a<landr> Ss; 


(1) 


abit gg <0 (4,07 S>0)o-a >a ta> land? > 3, TS] 


Henceforth we assume these formulas known, for rational r, s > 0. 


Next, we define a” for any real r > 0 and any element a > 1 in a complete 
field F’. 
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Let A,, denote the set of all members of F' of the form a”, with x € R and 
O0<2“<7r3 Le., 
Agr = {a* |0< a2 <7, & rational}. 


By the density of rationals in E+ (Theorem 3 of §10), such rationals x do exist; 
thus Agr # 0. 


Moreover, Ag, is right bounded in F’. Indeed, fix any rational number y > r. 
By the formulas in (1), we have, for any positive rational x <r, 


a’ = att -*) = g®q¥-* s at 
since a > 1 and y — x > 0 implies 
an? SI, 
Thus a¥ is an upper bound of all a® in Agr. 
Hence, by the assumed completeness of F’, sup Ag, exists. So we may define 
a” = sup Ag,.® 


We also put 


If0 <a<1 (so that + > 1), we put 
1\-" 1 
q = (-) anda ' = —., 
a ar 
where 1 
(-) = sup Ai Jays 
a 
as above. 
Summing up, we have the following definitions. 
Definition 2. 
Given a > 0 in a complete field F, and r € E', we define the following. 
(i) Ifr >0 and a> 1, then 
a” = sup Agr = sup{a®” |0<a<r, & rational}. 
(ii) If r > 0 and 0<a<1, then a” = War also written (1/a)~". 
(iii) a~" = 1/a”. (This defines powers with negative exponents as well.) 
3 Note that, if r is a positive rational itself, then a” is the largest a® with « < r (where a” 


and a” are as in Definition 1); thus a” = max Agr = sup Aar, and so our present definition 
agrees with Definition 1. This excludes ambiguities. 
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We also define 0" = 0 for any real r > 0, and a® = 1 for anya € F,a ¥ 0; 
0° remains undefined. 

The power a” is also defined if a < 0 and r is a rational = with n odd 
because a” = ~/a™ has sense in this case. (Why?) This does not work for 
other values of r. Therefore, in general, we assume a > 0. 

Again, it is easy to show that the formulas in (1) remain also valid for powers 
with real exponents (see Problems 8-13 below), provided F’ is complete. 


Problems on Roots, Powers, and Irrationals 


The problems marked by => are theoretically important. Study them! 


1. Let n € N in E!; let p > 0 and a > 0 be elements of an ordered field F. 
Prove that 


(i) if pp” >a, then (42 €F)p>a2>O0and 2" >a; 
(ii) if p” <a, then (Az € F) & > pand &” <a. 


[Hint: For (i), put 
x=p—d,withO<d<p. 


Use the Bernoulli inequality (Problem 5(ii) in §§5-6) to find d such that 
x” = (p—d)” >a, 


(1-5)"> — 


Solving for d, show that this holds if 


= <p. (Why does such a d exist?) 


)<d <= — 
np 


For (ii), if p” <a, then 
1 
pt 
Use (i) with a and p replaced by 1/a and 1/p.] 


> 


i 


2. Prove Theorem 1 assuming that 
(i an 
(ii) O0<a< 1 (the cases a = 0 and a = 1 are trivial). 


[Hints: (i) Let 
A={xeEF|a>1, 2” >a}. 
Show that A is bounded below (by 1) and A 4 @ (e.g., a+ 1 © A—why?). 
By completeness, put p = inf A. 
Then show that p” = a (i.e., p is the required /a). 
Indeed, if p” > a, then Problem 1 would yield an x € A with 


x < p=inf A. (Contradiction!) 
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Similarly, use Problem 1 to exclude p” < a. 
To prove uniqueness, use Problem 4(ii) of §85-6. 


Case (ii) reduces to (i) by considering 1/a instead of a.] 


3. Prove Note 1. 


[Hint: Suppose first that a is not divisible by any square of a prime, i.e., 


a= Ppip2°-*Pm, 


where the pz are distinct primes. (We assume it known that each a € N is the 
product of [possibly repeating] primes.) Then proceed as in the proof of Theorem 2, 
replacing “even” by “divisible by pz.” 
The general case, a = pb, reduces to the previous case since \/a = pvb.] 
4. Prove that if r is rational and q is not, then r + q is irrational; so also 
are rq, q/r, and r/q ifr #0. 


[Hint: Assume the opposite and find a contradiction.] 
=>5. Prove the density of irrationals in a complete field F: Ifa <b (a, be F), 
there is an irrational x € F with 


a<a<b 


(hence infinitely many such irrationals x). See also Chapter 1, 89, 
Problem 4. 
[Hint: By Theorem 3 of §10, 


(Ar€R) aV2<r<bv2, r#0. (Why?) 
Put « =r/V/2; see Problem 4]. 


6. Prove that the rational subfield R of any ordered field is Archimedean. 
(Hint: If 


k 
ge and geet (k,m,p,qE N), 
m qd 


then nz > y for n = mp + lJ. 


7. Verify the formulas in (1) for powers with positive rational exponents 
Bs 


8. Prove that 
(i) af? =a" a? and 
(ii) a’—* =a" /a for r, s€ E' andaé F (a> 0). 


[Hints: For (i), if r, s > 0 and a > 1, use Problem 9 in §§8-9 to get 


a’a® = sup Aar sup Aas = sup(Aar Aas). 


4 Tn Problems 8-13, F is assumed complete. In a later chapter, we shall prove the formulas 
in (1) more simply. Thus the reader may as well omit their present verification. The problems 
are, however, useful as exercises. 
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Verify that 
AarAas = {a a4 |x, yER,0<a<r,0<y<s} 
= {a*|zeER, O<z<r+s}=Aa rts. 


Hence deduce that 


a"a* = sup(Aa, rts) =a 1 


by Definition 2. 
For (ii), ifr > s > 0 and a > 1, then by (i), 


sO 


For the cases r < 0 or s < 0, or O < a < 1, use the above results and Defini- 
tion 2(ii) (iii).] 


. From Definition 2 prove that if r > 0 (r € E'), then 


a>1l<a'>l 


foraé F (a> 0). 
Prove for r, s € E! that 

(i t<eeSa <7 ita> 1 

(ii) ¢#<eepa’ Sa? if0<@ <1. 
[Hints: (i) By Problems 8 and 9, 


a= qa’ t(s-r) = q@"as-" >a" 


since a®-" >1lifa>lands—r>0. 
(ii) For the case 0 < a < 1, use Definition 2(ii).] 
Prove that 


(a-b)" =a’b" and (5): =e 


for r € E' and positive a, b € F. 
[Hint: Proceed as in Problem 8.] 


Given a, b > 0 in F and r € E!, prove that 
(i) a>bsa">b' ifr >0, and 
(i) “Shen <o tr <0. 
[Hint: 
a>be>F>1e3(F) >1 


if r > 0 by Problems 9 and 11]. 
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13. Prove that 
(a’)* = qa’? 
for r,s € El anda€é F (a> 0). 
[Hint: First let r, s > 0 and a> 1. To show that 
(a”)* =a"* = sup Aa, rs = sup{a*’ | z,yE R, 0< zy < rs}, 

use Problem 13 in §§8—9. Thus prove that 

(i) (Va, yER|O0< a2y< rs) a®¥ < (a")*, which is easy, and 

(ii) (Vd >1) (G2, yER|0<ay<rs) (a")* < da, 


Fix any d > 1 and put b= a". Then 
(a”)*° = b° = sup Ap, = sup{b¥ | ye R, O< y< s}. 
Hence there is some y € R, 0 < y < s such that 
(a")* <d3(a")¥. (Why?) 
Fix that y. Now 
a” = sup Agr = sup{a” |x ER, 0< a<r}; 


so 
1 
Sx2ER|O0<a<r) a’ <d2va*". (Why?) 


“=~ 


Combining all and using the formulas in (1) for rationals x, y, obtain 
1 
(a")® < d2(a")¥ < d2(d2¥a®)¥ = da™, 


thus proving (ii)]. 
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I. The Infinities. As we have seen, a set A 4 in E! has a lub (glb) if A 
is bounded above (respectively, below), but not otherwise. 

In order to avoid this inconvenient restriction, we now add to E! two new 
objects of arbitrary nature, and call them “minus infinity” (—oo) and “plus 
infinity” (+00), with the convention that —co < +oo and —oo < x < +00 for 
all x € E}. 

It is readily seen that with this convention, the laws of transitivity and 
trichotomy (Axioms VII and VIII) remain valid. 

The set consisting of all reals and the two infinities is called the extended 
real number system. We denote it by E* and call its elements extended real 
numbers. The ordinary reals are also called finite numbers, while too are the 
only two infinite elements of E*. (Caution: They are not real numbers.) 

At this stage we do not define any operations involving +oo. (This will 
be done later.) However, the notions of upper and lower bound, maximum, 
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minimum, supremum, and infimum are defined in E* exactly as in E!. In 
particular, 


—oo = min &* and +o = max E”. 


Thus in E* all sets are bounded. 

It follows that in E* every set A# has a lub and a glib. For if A has none 
in E', it still has the upper bound +00 in E*, which in this case is the unique 
(hence also the least) upper bound; thus sup A = +o0.! Similarly, inf A = —oo 
if there is no other lower bound.” As is readily seen, all properties of lub and glb 
stated in §88-9 remain valid in E* (with the same proof). The only exception 
is Theorem 2(ii’) in the case gq = +00 (respectively, p = —oo) since +00 — € 
and —oo + € make no sense. Part (ii) of Theorem 2 is valid. 

We can now define intervals in E* exactly as in E+ (§§8-9, Example (3)), 
allowing also infinite values of a, b, x. For example, 


(—o0, a) = {xz € E* |-co <a <a}={xe E' |e <a}; 
(a, 
(—00, +00) = {a € E* | -00 < ¢ < +00} = E!; 
[—o0, +00] = {x € E* | —0o < & < +00}; ete. 


) 
too) = {4 € E' |a< 2}; 
+00) 


Intervals with finite endpoints are said to be finite; all other intervals are called 
infinite. The infinite intervals 


(—o0, a), (—00, a], (a, +00), [a, +00), ac E’, 
are actually subsets of E+, as is (—oo, +00). Thus we shall speak of infinite 
intervals in E+ as well. 


II. Upper and Lower Limits.® In Chapter 1, §§1—3 we already mentioned 
that a real number p is called the limit of a sequence {x,,} C E+ (p = limz,) 
iff 


(Ve >0) (Sk) (Vn>k) |tn-—pl<e,ie,p—e<a4n<pte, (1) 
where ¢ € FE! andn, ke N. 
This may be stated as follows: 


For sufficiently large n (n > k), x» becomes and stays as close to p as we 
like (“e-close” ). 


1 This is true unless A consists of —oo alone, in which case sup A = —oo. 
2 It is also customary to define sup @ = —oo and inf @ = +00. This is the only case where 
sup A < inf A. 


3 This topic may be deferred until Chapter 3, §14. It presupposes Chapter 1, §8. 
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We also define (in E' and E*) 


lim In = too => (Va E') (Ak) (Vn >k) ay >a and (2) 
lim In = —00 => (WbE E*) (Ak) (Vn >k) an <b. (3) 


Note that (2) and (3) make sense in E1, too, since the symbols +oo do not 
occur on the right side of the formulas. Formula (2) means that x, becomes 
arbitrarily large (larger than any a € E! given in advance) for sufficiently large 
n(n >k). The interpretation of (3) is analogous. A more general and unified 
approach will now be developed for E* (allowing infinite terms x, too). 

Let {xz,} be any sequence in £*. For each n, let A, be the set of all terms 
from Zp onward, i.e., 


4 ie ete ke pe 
For example, 
Ag = {ig Pos sve by. Ae = {2K 13s w20-fy te 
The A, form a contracting sequence (see Chapter 1, §8) since 
Ay 2D Ag D8 
Now, for each n, let 
Dn = inf A, and gn = sup An, 
also denoted 
i us xt, and qn = “ue Lh. 


(These infima and suprema always exist in E*, as noted above.) Since A, D 
An+1, Corollary 2 of §§8—9 yields 


inf A, < inf Any, < sup Anyi < sup An. 
Thus 
Pi 5 Pe SS Py 5 Pest SS SS (4) 


and so {pn}t, while {qn}{ in E*. We also see that each qm is an upper bound 
of all py and hence 


On Sup py (= lub-of all p,). 
This, in turn, shows that this sup (call it Z) is a lower bound of all qm, and so 
Ee tl Ge: 


We put = 
int G4, = 2. 
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Definition 1. 
For each sequence {x,} C E*, we define its upper limit L and its lower 


limit L, denoted 


L=limz, = lim supz, and L = limz, = liminf zp, 


pee n—+00 
as follows. 
We put (Vn) 
Ge UD ee and py = i es 
as before. Then we set 
L = limay = inf qn and L = limz, = suppn, all in E*. (4) 


Here and below, inf, gp is the inf of all qn, and sup,, pn is the sup of all pn. 


Corollary 1. For any sequence in E*, 


inf x, < limz, < limz, < sup Zn. 
nm ~~ n 


For, as we noted above, 
L=supd, < inf ¢,, = L. 
Also, 
L > py, = inf A, > inf A; = inf x, and 


L < qn = sup Ay < sup Aj = sup zn, 


with A,, as above. 


Examples. 
(a) Let 
1 
Ln =. 
n 
Here 
_ fi 1 1 Vet 1 
qi = sup 7»? ae — *7 G2= 57 In =~ 
Hence 
= ., . 1 1 
T= inf gn = inf{1, sree aye } =O, 
n 2 nm 


as easily follows by Theorem 2 in 888-9 and the Archimedean property. 
(Verify!) Also, 
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Since all p, are 0, so is L = sup,, py. Thus here L = L = 0. 


(b) Consider the sequence 


1, —1, 2 : ! 
— —-—,...,N, —-,.... 
5] 2 FE) 2? 9 2 n’ 
Here 
1 1 
pi =—l1=po, P3 = —5 = Pay --+3 Pan-1 = —T = Pan: 
n 
Thus 
; 1 1 
lim n = sup pn = sup{ 1, Spey aye be 
— i 2 n 


On the other hand, g, = +00 for all n. (Why?) Thus 


limz, = inf gy, = +00. 


Theorem 1. 


(i) If x, > b for infinitely many n, then 
limz, >b as well. 


(ii) If, <a for all but finitely many n,* then 


limz, <a _ as well. 


Similarly for lower limits (with all inequalities reversed). 
Proof. 
(i) If x, > 6b for infinitely many n, then such n must occur in each set 
Aig = {i his Cn dG =e be 
Hence 
(Vm) dm = sup Am > b; 
so L = inf gm > b, by Corollary 1 of §§8-9. 
(ii) If x, < a except finitely many n, let no be the last of these “exceptional” 


values of n. 
Then for n > no, Ln < a, i.e., the set 


Ag, = AG hy Dts 2x} 
4In other words, for all except (at most) a finite number of terms zn. This is stronger 


than just “infinitely many n” (allowing infinitely many exceptions as well). Caution: Avoid 
confusing “all but finitely many” with just “infinitely many.” 
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is bounded above by a; so 


(Vn >10) dm =sup A, < a. 


Hence certainly L = infgq, <a. O 


Corollary 2. 
(i) If limz, >a, then x, >a for infinitely many n. 
(ii) If lima, <b, then x, <b for all but finitely many n. 


Similarly for lower limits (with all inequalities reversed). 


Proof. Assume the opposite and find a contradiction to Theorem 1. 


To unify our definitions, we now introduce some useful notions. 
By a neighborhood of p, briefly G,,° we mean, for p € E', any interval of 
the form 


(p—€,pte), e>0. 
If p = +00 (respectively, p = —0oo), G, is an infinite interval of the form 
(a, too] (respectively, [—00, b)), with a, b € E’. 


We can now combine formulas (1)—(3) into one equivalent definition. 
Definition 2. 


An element p € E* (finite or not) is called the limit of a sequence {x,,} in 
E* iff each G, (no matter how small it is) contains all but finitely many 
Xn, i.e. all x, from some x, onward. In symbols, 


(VG,) (Ak) (Wn>k) tn €G). (5) 


We shall use the notation 


p=limg, or lim r,. 
Nn co 


Indeed, if p € E', then z,, € Gp, means 
p-E<In<pte, 
as in (1). If, however, p = oo, it means 
Ln > a (respectively, rn, < b), 


as in (2) and (3). 


5 This terminology and notation anticipates some more general ideas in Chapter 3, §11. 
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Theorem 2. We have q=limz, in E* iff 
(i’) each neighborhood Gq contains x, for infinitely many n, and 


(ii!) ifq <b, then x, > b for at most finitely many n.® 


Proof. If g = limz,, Corollary 2 yields (ii’). 

It also shows that any interval (a, b), with a < q < b, contains infinitely 
many x, (for there are infinitely many x, > a, and only finitely many zx, > b, 
by (ii")). 

Now if q € E}," 

Ge=(—e,.9 8) 
is such an interval, so we obtain (i’). The cases g = +oo are analogous; we 
leave them to the reader. 

Conversely, assume (i’) and (ii’). 

Seeking a contradiction, let g < L; say, 


q<b<limz,. 


Then Corollary 2(i) yields x, > 6 for infinitely many n, contrary to our as- 
sumption (ii’). 
Similarly, q > lim, would contradict (i’). 


Thus necessarily g = lim xp. 


Theorem 3. We have q=limz,, in E* iff 


line, = lim 2, = g. 


Proof. Suppose 
limz, = lim tp, = g. 
If g € E', then every G, is an interval (a, b), a < q < b; therefore, Corol- 
lary 2(ii) and its analogue for lim, imply (with q treated as both lima, and 
lim x,,) that 
a<%, <6 for all but finitely many n. 


Thus by Definition 2, q = limz,,, as claimed. 

Conversely, if so, then any Gz (no matter how small) contains all but finitely 
many x,,. Hence so does any interval (a, b) witha < q < b, for it contains some 
small Gy. 

Now, exactly as in the proof of Theorem 2, one excludes 


q#limz, and q#limz,. 


This settles the case q € E'. The cases g = +00 are quite analogous. O 


° A similar theorem (with all inequalities reversed) holds for lim zn. 
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Problems on Upper and Lower Limits of Sequences in E* 


1. Complete the missing details in the proofs of Theorems 2 and 3, Corol- 
lary 1, and Examples (a) and (b). 


2. State and prove the analogues of Theorems 1 and 2 and Corollary 2 for 
lim Zp. 
3. Find limz,, and lima, if 
(a) Zp» = c (constant); 
(b) tn = —n; 
(ec) ty =n; aud 
(d) t, = (-1)"n—n. 
Does lim z,, exist in each case? 


=>4. A sequence {x,} is said to cluster at q € E*, and q is called its cluster 
point, iff each Gg contains x,, for infinitely many values of n. 


Show that both Z and L are cluster points (LZ the least and L the 
largest). 
[Hint: Use Theorem 2 and its analogue for L. 


To show that no p < L (or q > L) is a cluster point, assume the opposite and 
find a contradiction to Corollary 2.] 


=>5. Prove that 
(i) lim(—2z,) = —limaz, and 
(ii) lim(az,) =a- lima, if 0 <a < +o. 
6. Prove that a 
lim tp < +00 (lim zp, > —0o) 
iff {2,} is bounded above (below) in E!. 
7. Prove that if {z,,} and {y,} are bounded in E+, then 
lima, +limy, > lim(rp + yn) > lima, + lim yp, 
> lim(tn + Yn) 2 lima + lim yn. 
[Hint: Prove the first inequality and then use that and Problem 5(i) for the others.] 


=>8. Prove that if p = limz,, in E', then 
lim(tn + Yn) = p+ lim yn; 
similarly for L. 


=>9. Prove that if {x,} is monotone, then limz, exists in E*. Specifically, 
if {x,}t, then 


lime, = sup vas 
nm 
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and if {z,}{, then 
lim zx, = inf rp. 
=>10. Prove that 
(i) if lima, = +00 and (Vn) ay < Yn, then also lim y, = +00, and 
(ii) if lima, = —oo and (Vn) yn < Ln, then also lim yn, = —oo. 
11. Prove that if x, < yp for all n, then 


lima, <limy, and lima, < lim yp. 
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Chapter 3 
Vector Spaces. Metric Spaces 


§§1-3. The Euclidean n-Space, E” 


By definition, the Euclidean n-space E” is the set of all possible ordered n- 
tuples of real numbers, i.e., the Cartesian product 


E! x E'x.--x E" (n times). 
In particular, E? = E' x EF! = {(a, y)| 2, y € E'}, 
EX = Ex Ex BE ={(z, y, 2) | 2, y, 2 € E’}, 


and so on. E! itself is a special case of E” (n = 1). 

In a familiar way, pairs (xz, y) can be plotted as points of the xy-plane, or 
as “vectors” (directed line segments) joining (0, 0) to such points. Therefore, 
the pairs (x, y) themselves are called points or vectors in E?; similarly for E°. 

In E” (n > 3), there is no actual geometric representation, but it is con- 
venient to use geometric language in this case, too. Thus any ordered n-tuple 
(41, 2, ..-, py) of real numbers will also be called a point or vector in EF”, and 
the single numbers 21, %2, ..., Yn are called its coordinates or components. A 
point in E” is often denoted by a single letter (preferably with a bar or an 
arrow above it), and then its n components are denoted by the same letter, 
with subscripts (but without the bar or arrow). For example, 


C= iis 6 nea OS 0, 2nG Ue) CIs 


% = (0, —1, 2, 4) is a point (vector) in E* with coordinates 0, —1, 2, and 4 
(in this order). The formula z € E” means that % = (#1, ..., Zn) is a point 
(vector) in EB”. Since such “points” are ordered n-tuples, Z and y are equal 
(z = y) iff the corresponding coordinates are the same, i.e., 21 = Y1, 2 = Yo, 
+, £n = Yn (see Problem 1 below). 
The point whose coordinates are all 0 is called the zero-vector or the origin, 
denoted 0 or 0. The vector whose kth component is 1, and the other components 
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are 0, is called the kth basic unit vector, denoted é€;. There are exactly n such 
vectors, 

ep = (1,.0,.0, cy 0), Bo = (0-1, 0 Oy ccs, Gp = (ce, OTe 


In E°%, we often write i, 7, and k for €1, &2, &3, and (a, y, z) for (x1, x2, 73). 
Similarly in E?. Single real numbers are called scalars (as opposed to vectors). 


Definitions. 


Given £ = (21, ..., Zn) and ¥ = (y1,---, Yn) in E”, we define the fol- 
lowing. 


1. The sum of % and y, 
E+y=(ti ty, t2+yo,-.., tn + Yn) (hence +0 = 2).' 
2. The dot product, or inner product, of % and y, 
LY =@M1Y1 + Taya +++ + Lnyn.- 
3. The distance between % and y, 
pz, 9) = V (@1 — 91)? + (G2 — yo)? +++ + (En — Yn)? . 
4. The absolute value, or length, of %, 


Ia] = /2? + a3 +---+02 = pla, 0) = VEE 


(three formulas that are all equal by Definitions 2 and 3). 


5. The inverse of Z, 


6. The product of Z by a scalar c € E', 


Cf = fe= (Cn. Cio, 2362 Ce 


ol 


in particular, (—1)% = (—21, —2,..., —%n) = —Z, 1Z = Z, and 0 = 
7. The difference of x and y, 
_ = — 
LY = yL = (%1 — Yi, L2 — Ya, ---; Ln — Yn). 
In particular, 7-0 = z and 0 — Z = —2. (Verify!) 
Note 1. Definitions 2—4 yield scalars, while the rest are vectors. 


Note 2. We shall not define inequalities (<) in E” (n > 2), nor shall 
we define vector products other than the dot product (2), which is a scalar. 
(However, cf. §8.) 


1 Sums of three or more vectors are defined by induction, as in Chapter 2, §85-6. 
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Note 3. From Definitions 3, 4, and 7, we obtain p(Z,y) = | — y|. (Verify!) 
Note 4. We often write /c for (1/c)Z, where c € E!, c £0. 
Note 5. In £1, % = (41) = 21. Thus, by Definition 4, 


Iz] = Vat = |i], 


where |x1| is defined as in Chapter 2, §§1—4, Definition 4. Thus the two defini- 
tions agree. 

We call Z a unit vector iff its length is 1, ie., |x] = 1. Note that if z 4 0, 
then Z/|Z| is a unit vector, since 


lal= 
Z| 
The vectors £ and y are said to be orthogonal or perpendicular (x L y) iff 


Z-y =O and parallel (z || y) iff Z = ty or ¥ = tz for some t € E!. Note that 
z 1 0 and = || 0. 


Examples. 
If z = (0, —1, 4, 2 


o(z, 9) = |Z —g| = V2? + 32+ 724+ 0? = VO2; 
(2+ 9) -(-—Y) = 2(-2) + 1(-3) +7+0=0. 
So (+ y) 1 ( —y) here 


Theorem 1. For any vectors Z, y, and Z € E” and any a, b € E', we have 


(a) + y and az are vectors in E” (closure laws); 


(b) + y=Y+2Z (commutativity of vector addition); 


(f£+y)+2=£+ (94+ Z) (associativity of vector addition); 


0=04+2% =, i.e., 0 is the neutral element of addition; 
(—Z) 


Proof. Assertion (a) is immediate from Definitions 1 and 6. The rest follows 
from corresponding properties of real numbers. 
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For example, to prove (b), let = (1, ..., Zn), ¥ = (Y1, ---; Yn). Then by 
definition, we have 
E+9= (M1 +41,---, Fn t+ yn) and ¥+%= (yr t21,---, Yn + Fn). 


The right sides in both expressions, however, coincide since addition is com- 
mutative in E'. Thus + 7 = ¥ +2, as claimed; similarly for the rest, which 
we leave to the reader. 


Theorem 2. /f % = (1, ..., Zn) is a vector in E”, then, with €, as above, 


mr 
L= XC, + XQ€Qg + +++ + Cn€n = y Lek. 
k=) 


Moreover, if Z = vp _, Grex for some ax € E', then necessarily a, = 2k, 
= 1, vey hs 
Proof. By definition, 
@y (1, 0) ancy 0))-Sy = (Oy 2290), ccc Gy = 0.0; cx, 1): 
Thus 
£161 = (01, 0, «<5 0), Woes = (0) ay ccnp wry GeO = (0, Op ce ny By). 


Adding up componentwise, we obtain 
n 
) Gpee = (Lis Ho, rag) =H, 
k=1 


as asserted. 
Moreover, if the x2, are replaced by any other a, € E!', the same process 
yields 
(Gi, cing tin) = B= (yy wesy Wn); 


i.e., the two n-tuples coincide, whence ay, = t%, k= 1, ..., n. 


Note 6. Any sum of the form 
Sante (ax € EB. TeE E”) 
k=1 


is called a linear combination of the vectors Z, (whose number m is arbitrary). 
Thus Theorem 2 shows that any x € E” can be expressed, in a unique way, as 
a linear combination of the n basic unit vectors. In E?, we write 


E=2Xyt+ 22) + 23k. 
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Note 7. If, as above, some vectors are numbered (e.g., 21, T2, -.-, Em), 
we denote their components by attaching a second subscript; for example, the 
components of %1 are 411, %12, .--, Lin- 


Theorem 3. For any vectors z, y, and z € E” and any a, b € E', we have 
(a) Z-Z>0, andz-z>0 iff <4 0; 


(b) (ax) - (by) = (ab)(z-y); 
(c) £-Y=y-= (commutativity of inner products); 
(d) (@+9)-2=2-Z+Y-2Z (distributive law). 


Proof. To prove these properties, express all in terms of the components of Z, 
y, and Z, and proceed as in Theorem 1. 


Note that (b) implies 7-0 = 0 (put a= 1, b= 0). 


Theorem 4. For any vectors and y € E” and anya € E!', we have the 
following properties: 


(a’) |z| > 0, and |z| > 0 iff z 4 0. 
(b’) |az| = Jal|z]. 
(c’) |z-y| < |z||y|, or, in components, 
n 2 n n 
63 vi) < @ it) (>: Ht) (Cauchy-Schwarz inequality). 
k=1 k=1 k=1 


Equality, |%-y| = |2| |y|, holds iff x || y- 


(d’) |Z+y]| < |Z] +|gy| and ||z| — |y|| < |Z — g| (triangle inequalities). 
Proof. Property (a’) follows from Theorem 3(a) since 
|z|“ = x-& (see Definition 4). 


For (b’), use Theorem 3(b), to obtain 


(az) - (ax) = a? (&-%) = a? |Z? 
By Definition 4, however, 
(az) - (aX) = |az|?. 
Thus 
Jaz|? = a? |2|? 
so that |az| = |a||z|, as claimed. 
Now we prove (c’). If z || y then % = ty or y = tZ; so |%- y| = |Z||y| follows 


by (b’). (Verify!) 
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Otherwise, z 4 ty and y ¥ tz for allt € E!. Then we obtain, for all t € E', 


n 


0 # [te — 9? = (tax — yn)? =O D> oh - 2 >> wey + > e- 
k=1 k=1 k=1 


k=1 


Thus, setting 


A=) 2k, B=2)o 2iye, and C => yf, 

k=1 k=1 k=1 

we see that the quadratic equation 
0= At? — Bt+C 
has no real solutions in t, so its discriminant, B? —4AC, must be negative; i.e., 
n 2 n n 
a(S ewe) —4(So8) (Sok) <0 
k=1 k=1 k=1 


proving (c’). 
To prove (d’), use Definition 2 and Theorem 3(d), to obtain 


je+g/? =(@4+-9)- (+9) =2-E+9-9+ 22-9 = |Z|? + gl? + 22-7. 
But Z-y < |z| |y| by (c’). Thus we have 


JE +9) < le)? + lal? + 2]@| |g = Ce] + Ig)’, 


whence |% + y| < |Z| + |g], as required. 
Finally, replacing here % by Z — y, we have 


je—y| + ly] 2 |\e—9+y9| = |z|, or |e —g| > |z| — |g/- 


Similarly, replacing y by y — Z, we get | — y| > |y| — |z|. Hence 
jz — gl = +(|2| — |gl), 


, proving the second formula in (d’). O 


Le., | — 9] = ||=| — [al 
Theorem 5. For any points x, y, and Zz € E”, we have 
(i) p(@, 9) 2 0, and p(z, y) = 0 iff t= 9; 
(ii) p(z, ¥) = ey, Z); 
(iii) p(Z, Z) < p(%, y) + p(y, Z) (triangle inequality). 
Proof. 
(i) By Definition 3 and Note 3, p(z, y) = |z—y]; therefore, by Theorem 4(a’), 
p(Z, y) = |% —y| 2 0. 
Also, | — y| > 0 iffz-—y #0, i-e., iff z # y. Hence p(%, y) £ 0 iff 
x # y, and assertion (i) follows. 
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(ii) By Theorem 4(b’), |Z — y| = |(—1)(y — £)| = |y — Z|, so (ii) follows. 
(iii) By Theorem 4(d’), 


pz, 9) + pY, Z) = |e -—9| + |9 —2| = |Z -—9¥ +9 —2| = pl, Z). 


Note 8. We also have |p(z, y) — p(Z, y)| < p(z, Z). (Prove it!) The two 
triangle inequalities have a simple geometric interpretation (which explains 
their name). If z, y, and Z are treated as the vertices of a triangle, we obtain 
that the length of a side, p(Z, Z) never exceeds the sum of the two other sides 
and is never less than their difference. 

As E? is a special case of E” (in which “vectors” are single numbers), all 
our theory applies to E! as well. In particular, distances in E! are defined by 
p(x, y) = |x — y| and obey the three laws of Theorem 5. Dot products in E} 
become ordinary products zy. (Why?) From Theorems 4(b’)(d’), we have 


lal |x| = Jax|; |x +yl < [21 +lyl; le —yl 2 |lzl—lyl| (a, 2, ye BE’). 


Problems on Vectors in E™ 


1. Prove by induction on n that 


Fig te i i) = Hie US ses 1 eS a = Ler 
[Hint: Use Problem 6(ii) of Chapter 1, §§1-3, and Example (i) in Chapter 2, §§5-6.] 
2. Complete the proofs of Theorems 1 and 3 and Notes 3 and 8. 
3. Given Z = (—1, 2, 0, —7), y = (0, 0, —1, —2), and Zz = (2, 4, —3, —3) 
in E*, express %, y, and Z as linear combinations of the basic unit 
vectors. Also, compute their absolute values, their inverses, as well as 


their mutual sums, differences, dot products, and distances. Are any of 
them orthogonal? Parallel? 


4. With Z, y, and Z as in Problem 8, find scalars a, b, and c such that 


az + by + cz = u, 


when 
(i) @=&; (ii) @ = é3; 
(iii) a = (—2, 4, 0, 1); (iv) w=0 
5. A finite set of vectors %, T2,..., Zm is said to be dependent iff there are 
scalars a1, ..., Gm, not all zero, such that 


m 
) apr, = 0, 


k=1 
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and independent otherwise. Prove the independence of the following 
sets of vectors: 


(a 

(b 
(c 
(d 


) éy eet: A 

(1, iene coe 

) ae 0, ii) (4, —1, 3), and (0, 4, 1) in E°; 
)t 


he vectors Z, ¥, and Z of Problem 3. 


. Prove (for E* and E?) that 


t-Y¥ = |2| |yl cosa, 


— — 
where a is the angle between the vectors 0x and Oy; we denote a by 
(7, 9). 
= — — ee 
[Hint: Consider the triangle 0%Y, with sides 7 = Ox, y = Oy, and zy = y¥ — & (see 
Definition 7). By the law of cosines, 
|Z? + |gl? — 2|2| |g| cosa = |7— ZI’. 


Now substitute |z|? = %- Z, |gl? =7-y, and 


Then simplify.] 


. Motivated by Problem 6, define in E” 


Z-y 
(Z, y) = arccos al al if Z and y are nonzero. 
T\ \y 


(Why does an angle with such a cosine exist?) Prove that 


(i). eo ay i cos ay) = 0 1. yg) = 


(ii) S © cos?(z, @) = 1. 
k=1 


uF 
9” 


. Continuing Problems 3 and 7, find the cosines of the angles between 


the sides, zy, Ye, and za of the triangle 7yZ, with Z, y, and Z as in 
Problem 3. 


. Find a unit vector in E+, with positive components, that forms equal 


angles with the axes, i.e., with the basic unit vectors (see Problem 7). 


Prove for E” that if u is orthogonal to each of the basic unit vectors é,, 
€2,..., En, then u = 0. Deduce that 


u=Oiff (VzZe E")z-u=0. 
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11. Prove that % and y are parallel iff 
Ly 22 Poi 
where “x;,/y, =” is to be replaced by “xr, = 0” if yx = 0. 


e (ce LE"), 


12. Use induction on n to prove the Lagrange identity (valid in any field), 
n n n 2 
(> 2) ut) = (>: rag = oy (ciYn — CRYi)*. 
k=1 k=1 k=1 1<i<k<n 
Hence find a new proof of Theorem 4(c’). 


13. Use Problem 7 and Theorem 4(c’) (“equality”) to show that two nonzero 
vectors £ and y in E” are parallel iff cos(z, y) = +1. 


14. (i) Prove that |Z + y| = |Z| + |y| iff c = ty or y = tz for some t > 0; 
equivalently, iff cos(z, y) = 1 (see Problem 7). 


(ii) Find similar conditions for |z — y| = |z| + |g. 
[Hint: Look at the proof of Theorem 4(d’).| 


§§4-6. Lines and Planes in E” 


I. To obtain a line in E? or E? passing through two points @ and b, we take 
the vector 


—> 
u=ab=b-4a 
and, so to say, “stretch” it indefinitely in both directions, i.e., multiply u by 
all possible scalars t € E!. Then the set of all points % of the form 
E=a+tu 

is the required line. It is natural to adopt this as a definition in E” as well. 
Below, a # b. 

Definition 1. 


The line ab through the points G, b € E” (also called the line through a, 
in the direction of the vector ii = b — @) is the set of all points  € E” of 
the form 


where t varies over E'. We call t a variable real parameter and @ a 
direction vector for ab. Thus 


Line ab = {@ € E”|Z=a4+ti forsometc E'}, @=b-a440. (1) 
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The formula 


E=G4+tu, or ==4+t(b—@), 
is called the parametric equation of the line. (We briefly say “the line 7 = 


a+ tu.”) It is equivalent to n simultaneous equations in terms of coordinates, 
namely, 


Lp = Ap +tuy = ag + t(by — ag), FSD lawn he (2) 


Note 1. As the vector w@ is anyway being multiplied by all real numbers f, 
the line (as a set of points) will not change if @ is replaced by some ct (c € E?, 
c #0). In particular, taking c = 1/|t|, we may replace @ by w/|u|, a unit 
vector. We may as well assume that wu is a unit vector itself. 

If we let ¢ vary not over all of E! but only over some interval in E', we obtain 
what is called a line segment.! In particular, we define the open line segment 
L(a, b), the closed line segment La, b], the half-open line segment L(a, b], and 
the half-closed line segment L|a,b), as we did for E'. 


Definition 2. 


Given u = b— 4G, we set 


[a, b 
[a, b 
In all cases, a@ and b are called the endpoints of the segment; p(a, b) = 
|b — a| is its length; and s(a + b) is its midpoint. 


}={a+ti|0<t<1}; 


(i) L(a, b) ={a+te|0<t<1};? (ii) 
b )={a+ta|0<t<1}; 


{ i 
(iii) L(G, b] ={a+tad|0<t<1}; (iv) L 


Note that in E1, line segments simply become intervals, (a, b), [a, b], etc. 
II. To describe a plane in E*, we fix one of its points, @, and a vector 


—> 
u = ab perpendicular to the plane (imagine a vertical pencil standing at a on 
the horizontal plane of the table). Then a point Z lies on the plane iff @ L an. 
It is natural to accept this as a definition in E” as well. 


Definition 3. 
Given a point @ € E” and a vector @ ¥ 0, we define the plane (also called 
hyperplane if n > 3) through a, orthogonal to tw, to be the set of all z € E” 
such that w L az, i.e., U- (Z — @) = 0, or, in terms of components, 


> ux(@p — Ge) =0, where @ £0 (i.e., not all values uz are 0). (3) 
k=1 


1 We reserve the name “interval” for other kinds of sets (cf. §7). 
? This is an abbreviation for “{z € E” | =a@+td for some t € E1, 0 <t < 1}.” 
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We briefly say 


“the plane t- (Z—a@) = 0” or “the plane So ugar — az) = 0” 
k=1 


(this being the equation of the plane). Removing brackets in (3), we have 


nr 
U1,Lo + Ug®o +++: +Untn =C, or U-£=c, where c= y Upae, UFO. (4) 


k-1 
An equation of this form is said to be linear in 11, ©2, ..., Un- 
Theorem 1. A set A C E” is a plane (hyperplane) iff A is exactly the set of 
all Z € E™ satisfying (4) for some fixed c € E+ and @ = (wu, ..., Un) £0. 


Proof. Indeed, as we saw above, each plane has an equation of the form (4). 
Conversely, any equation of that form (with, say, u; 4 0) can be written as 


é 
wa (21 — —) + Ugh%2 + U3%3 +++: +Unty = 0. 
1 

Then, setting a, = c/u, and ax = 0 for k > 2, we transform it into (3), which is, 
by definition, the equation of a plane through a = (c/u1, 0, ..., 0), orthogonal 
be =" (Wy peng Aly 


Thus, briefly, planes are exactly all sets with linear equations (4). In this 
connection, equation (4) is called the general equation of a plane. The vector w 
is said to be normal to the plane. Clearly, if both sides of (4) are multiplied by 
a nonzero scalar q, one obtains an equivalent equation (representing the same 
set). Thus we may replace ux by qux, i.e., @ by qu, without affecting the plane. 
In particular, we may replace @ by the unit vector t/|t|, as in lines (this is 
called the normalization of the equation). Thus 


Uu 
qa) (5) 
and " 
U 
rE=at+t— 6 
ial (6) 


are the normalized (or normal) equations of the plane (3) and line (1), respec- 
tively. 


Note 2. The equation x; = c (for a fixed k) represents a plane orthogonal 
to the basic unit vector €;, or, as we shall say, to the kth axis. The equation 
results from (4) if we take i = & so that ux, = 1, while u; = 0 (i # k). For 
example, x, = c is the equation of a plane orthogonal to €;; it consists of all 
z € E”, with 2; =c (while the other coordinates of Z are arbitrary). In E, it 
is a line. In E!, it consists of c alone. 
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Two planes (respectively, two lines) are said to be perpendicular to each 
other iff their normal vectors (respectively, direction vectors) are orthogonal; 
similarly for parallelism. A plane u- Z = c is said to be perpendicular to a line 
x =a-+tv iff @ || v; the line and the plane are parallel iff u L v. 


Note 3. When normalizing, as in (5) or (6), we actually have two choices 
of a unit vector, namely, +u/|u|. If one of them is prescribed, we speak of a 
directed plane (respectively, line). 


Examples. 


(a) 


Let a = (0, —1, 2), b= (1, 1, 1), andé = (3, 1, -1) in E?. Then the line 


ab has the parametric equation Z = 4+t(b—4@) or, in coordinates, writing 
L,Y, 4 for 1, 2, ©3, 


x=0+t(1-0)=t, y=-1+2t, z=2-t. 
This may be rewritten 


etl 2=2 
ee ae oC. 


fo 
a 


where ti = (1, 2, —1) is the direction vector (composed of the denomina- 
tors). Normalizing and dropping t, we have 


orl. #2 


V6 2/V6  —1/V6 


(the so-called symmetric form of the normal equations). 
Similarly, for the line bc, we obtain 


G=1 yl wl 


t= as 
2 0 =o 


where “t = (y — 1)/0” stands for “y—1= 0.” (It is customary to use this 
notation. ) 

Let @ = (1, —2, 0, 3) and @ = (1, 1, 1, 1) in E*. Then the plane normal 
to u through @ has the equation (% — a) -v = 0, or 


(ey = 1) <1 (Gp 42) 14 Gp 0) oF + Ge 8) - 1 Sty 


or 41 +%2+ 23 +24 = 2. Observe that, by formula (4), the coeffi- 
cients of 21, 2, 23, L4 are the components of the normal vector t (here 
irae a Ua Fa 

Now define a map f: E* > E! setting f(%) = 21+ 22+ 23+ 24 (the 
left-hand side of the equation). This map is called the linear functional 
corresponding to the given plane. (For another approach, see Problems 4— 
6 below.) 
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(c) The equation x+3y—2z = 1 represents a plane in E°, with @ = (1, 3, —2). 
The point a = (1, 0, 0) lies on the plane (why?), so the plane equation 
may be written (—a)-d@ = 0 or -%@ = 1, where & = (a, y, z) and @ and 
u are as above. 


Problems on Lines and Planes in E”™ 


1. Let a = (-1, 2, 0, —7), b = (0, 0, —1, 2), and @ = (2, 4, —3, —3) be 
points in £*. Find the symmetric normal equations (see Example (a)) of 
the lines ab, bc, and ta. Are any two of the lines perpendicular? Parallel? 
On the line ab, find some points inside L(@, b) and some outside L[a, 6]. 
Also, find the symmetric equations of the line through ¢ that is 


(i) parallel to ab; (ii) perpendicular to ab. 


2. With a and b as in Problem 1, find the equations of the two planes that 
trisect, and are perpendicular to, the line segment L|a, 0]. 


3. Given a line  =a+ td (¢ =b-—a@ 40) in E”, define f: E! > E” by 
f(t) =G@+4+td for t € El. 


Show that L]@, b] is exactly the f-image of the interval [0, 1] in E+, with 
f(0) =a and f(1) =), while f[E"] is the entire line. Also show that f 
is one to one. 

[Hint: t 4 t’ implies |f(t) — f(t’)| 4 0. Why?] 


4. A map f: E” — E! is called a linear functional iff 
(VZ,9 CE") (Va,bCE') f(at+by) = af (Zz) +bf(y). 


Show by induction that f preserves linear combinations; that is, 
10D aut) = So af (%) 
k=1 k=1 


for any az, € E+ and x € E”. 


5. From Problem 4 prove that a map f: E” — E! is a linear functional iff 
there is w € E” such that 


(V2eEkE”) f(#)=u-z (“representation theorem” ). 


[Hint: If f is a linear functional, write each @ € E” as & = Yop_) ceex (§§1-3, 


Theorem 2). Then 
f(@) = 103 oer ) = ted En) 
k=1 k=1 


Setting u, = f(&,) € BE! and @= (ui, ..., un), obtain f(%) = @-Z, as required. For 
the converse, use Theorem 3 in §§1-3.] 
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6. Prove that a set A C E” is a plane iff there is a linear functional f 
(Problem 4), not identically zero, and some c € E' such that 


A={@eEE"| f(z) =c}. 


(This could serve as a definition of planes in E”.) 
[Hint: A is a plane iff A= {Z| u-% =c}. Put f(%) = @-& and use Problem 5. Show 
that f £0 iff @ 40 by Problem 10 of §§1-3.] 


7. Prove that the perpendicular distance of a point p to a plane u- % = c 
in E£” is 


(Zo is the orthogonal projection of p, i.e., the point on the plane such 
— is 

that pxo || w.) 

[Hint: Put ¢ = w/|u|. Consider the line = p+ tv. Find t for which p + tw lies on 

both the line and plane. Find |¢|.] 


8. A globe (solid sphere) in £”, with center p and radius ¢ > 0, is the set 
{z | p(%, p) < e}, denoted G(c). Prove that if a, b € Ga(e), then also 
La, 6] C G5(e). Disprove it for the sphere Sp(e) = {Z | p(Z, p) = €}. 
[Hint: Take a line through p.] 


§7. Intervals in E” 


Consider the rectangle in E? shown 
in Figure 2. Its interior (without 
the perimeter) consists of all points 
(x, y) € E? such that 


ay <x < by and ag < y < bo; 


L.e., 


© € (a1, bi) and y € (ae, ba). 


FIGURE 2 


Thus it is the Cartesian product of 

two line intervals, (a,, 61) and (ag, b2). To include also all or some sides, 
we would have to replace open intervals by closed, half-closed, or half-open 
ones. Similarly, Cartesian products of three line intervals yield rectangular 
parallelepipeds in E%. We call such sets in E” intervals. 


Definitions. 


1. By an interval in E” we mean the Cartesian product of any n intervals 
in E+ (some may be open, some closed or half-open, etc.). 
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2. In particular, given 
@ = (G4,..225 a) and b = Oi, 2.24 by) 
with 
ak <—Dps n=, 2, 2 TN, 


we define the open interval (4G, b), the closed interval [a, b], the half-open 
interval (a, b|, and the half-closed interval |a, b) as follows: 


(a,b) = 42 | a, < ay < by, RH 1, 2 2 nt 
= (a1, 61) X (ae, be) X +--+ X (An, bn); 
[a,b] = {am |p < ay < dy, RH 1, Oy... 70} 
= |ai, bi] x [ag, be] x +--+ X [an, bn]; 
(a, b=4z | mp oe bis b= 1 Os 
= (ai, 01| X (Ga, bal Ko? & (any Oy: 
(as OS ee |e ee es, BSN ea Ty 


=> [ay, by) x [a2, bz) > 4 [Chas ae 


In all cases, @ and b are called the endpoints of the interval. Their distance 
is called its diagonal. The n differences 
by — ay = Lr (i= 1. eee 


are called its n edge-lengths. Their product 


[| & => [[@ = ar) 
k=1 k=1 
is called the volume of the interval (in E? it is its area, in E! its length). The 
point 
a= (a+ 6) 
c= ~(a 
2 
is called its center or midpoint. The set difference 
[a, b] > (a, b) 
is called the boundary of any interval with endpoints @ and 6; it consists of 2n 
“faces” defined in a natural manner. (How?) 
We often denote intervals by single letters, e.g., A = (a, b), and write dA for 
“diagonal of A” and vA or volA for “volume of A.” If all edge-lengths b;, — ax 
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are equal, A is called a cube (in E?, a square). The interval A is said to be 
degenerate iff by, = az for some k, in which case, clearly, 


vol A = [[@ = ar) = 0. 


k=1 


Note 1. We have Z € (a, b) iff the inequalities a, < xy < by hold simul- 
taneously for all k. This is impossible if a, = by for some k; similarly for the 
inequalities a, < x, < by or ap < aE < by. Thus a degenerate interval is 
empty, unless it is closed (in which case it contains @ and 6 at least). 


Note 2. In any interval A, 


dA = (a, b) = 4/S— (be — ax)? = 4/9 @. 
k=1 k=1 


In E?, we can split an interval A into two subintervals P and Q by drawing 
a line (see Figure 2). In E%, this is done by a plane orthogonal to one of the 
axes of the form xr, = c (see §§4-6, Note 2), with a, < c < bg. In particular, if 
c= 4(ax +x), the plane bisects the kth edge of A; and so the kth edge-length 
of P (and Q) equals $2, = $(bj, — ax). If A is closed, so is P or Q, depending 
on our choice. (We may include the “partition” x, = c in P or Q.)! 

Now, successively draw n planes 
Te = Ce, Ce = Glan + by), & = 
1,2,...,n. The first plane bisects 
é; leaving the other edges of A un- 
changed. The resulting two subinter- 
vals P and Q then are cut by the 
plane t2 = c2, bisecting the sec- 
ond edge in each of them. Thus we 
get four subintervals (see Figure 3 for 
E?). Each successive plane doubles 
the number of subintervals. After n 
steps, we thus obtain 2” disjoint intervals, with all edges ¢; bisected. Thus by 
Note 2, the diagonal of each of them is 


fl he it te il 
—~,) =H 02 = —dA. 
XG ‘) a 2 2 


Note 3. If A is closed then, as noted above, we can make any one (but only 
one) of the 2” subintervals closed by properly manipulating each step. 


Y 


FIGURE 3 


The proof of the following simple corollaries is left to the reader. 


1 We have either P={%E€ A| ay <chandQ={%EA|a,>ch,orP={ZEA| zy < ch 
and Q@={ZEA| ap > c}. 
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Corollary 1. No distance between two points of an interval A exceeds dA, its 
diagonal. That is, (V%,y € A) p(%, y) < dA. 


Corollary 2. If an interval A contains p and q, then also L{p, q| C A. 


Corollary 3. Every nondegenerate interval in E” contains rational points, 
1.e., points whose coordinates are all rational. 


(Hint: Use the density of rationals in E! for each coordinate separately.) 


Problems on Intervals in E” 
(Here A and B denote intervals.) 
1. Prove Corollaries 1-3. 
2. Prove that if A C B, then dA < dB and vA < vB. 
3. Give an appropriate definition of a “face” and a “vertex” of A. 
4. Find the edge-lengths of A = (a, b) in E% if 
@ = (1, —2, 4, 0) and 6 = (2, 0, 5, 3). 
Is A a cube? Find some rational points in it. Find dA and vA. 


5. Show that the sets P and Q as defined in footnote 1 are intervals, indeed. 
In particular, they can be made half-open (half-closed) if A is half-open 
(half-closed). 

(Hint: Let A = (4, 0], 
P={£EA|a,<c}h,andQ={@EA| a, > c}. 
To fix ideas, let k = 1, i.e., cut the first edge. Then let 
p = (c, a2,..., Gn) and g = (c, be, ..., bn) (see Figure 2), 
and verify that P = (a, q| and Q = (jp, 6]. Give a proof.] 

6. In Problem 5, assume that A is closed, and make Q closed. (Prove it!) 

7. In Problem 5 show that (with & fixed) the kth edge-lengths of P and Q 
equal c — ay, and by — c, respectively, while for i 4 k the edge-length ¢; 
is the same in A, P, and Q, namely, €; = b; — a. 

[Hint: If k = 1, define p and @ as in Problem 5.] 
8. Prove that if an interval A is split into subintervals P and Q (PNQ = 0), 


then vA = vP + vQ. 

[Hint: Use Problem 7 to compute vA, vP, and vQ. Add up.] 

Give an example. (Take A as in Problem 4 and split it by the plane 
La = 3) 


*9. Prove the additivity of the volume of intervals, namely, if A is subdivided, 
in any manner, intom mutually disjoint subintervals A,, Ao, ..., Am 
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in BE”, then 


vA= ‘ vA;. 
i=1 


(This is true also if some A; contain common faces). 

[Proof outline: For m = 2, use Problem 8. 
Then by induction, suppose ad- 

ditivity holds for any number of in- 

tervals smaller than a certain m 

(m > 1). Now let 


A=|[JAi (Ai disjoint). 
i=1 


One of the A; (say, A1 = 4, p]) 
must have some edge-length smaller 
than the corresponding edge-length 
of A (say, €1). Now cut all of A into 
P =a, dj and Q = A—P (Figure 4) FIGURE 4 

by the plane x1 = c (c= p1) so that 

A, C P while Ag C Q. For simplicity, assume that the plane cuts each A; into two 
subintervals A‘ and A‘’/. (One of them may be empty.) 


Then 


p=(Ja! and Q= (J AY. 


i=l i=l 


Actually, however, P and Q are split into fewer than m (nonempty) intervals since 
A =@ = Aj by construction. Thus, by our inductive assumption, 


mm mm 
vP= e vAj, and vQ = Le vAL, 
al w=1 


where vA// = 0 = vA, and vA; = vA +vAl’ by Problem 8. Complete the inductive 
proof by showing that 


vA=vP+vQ= So vAe] 
tv=1 


§8. Complex Numbers 


With all the operations defined in §$1-3, E” (n > 1) is not yet a field because 
of the lack of a vector multiplication satisfying the field axioms. We shall now 
define such a multiplication, but only for E?. Thus E? will become a field, 
which we shall call the complex field, C. 
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We make some changes in nota- 
tion and terminology here. Points of 
E?, when regarded as elements of C, 
will be called complex numbers (each 
being an ordered pair of real num- 
bers). We denote them by single let- 
ters (preferably z) without a bar or 
an arrow. For example, z = (z, y). 


F 5 
We preferably write (x, y) for (#1, 22). If z = (a, y), then 2 and y are called 


the real and imaginary parts of z, respectively,| and z denotes the complex 
number (x, —y), called the conjugate of z (see Figure 5). 


Complex numbers with vanishing imaginary part, (x, 0), are called real 
points of C’. For brevity, we simply write x for (x, 0); for example, 2 = (2, 0). 
In particular, 1 = (1, 0) = 6; is called the real unit in C. Points with van- 
ishing real part, (0, y), are called (purely) imaginary numbers. In particular, 
82 = (0, 1) is such a number; we shall now denote it by i and call it the imag- 
inary unit in C. Apart from these peculiarities, all our former definitions of 
§§1-3 remain valid in E? = C. In particular, if z = (z, y) and z' = (2’, y’), we 
have 

zt2'=(2,y)+(e',y')=(e@ta',y+y)), 


plz, 2) = V(x@—-2')? +(y—y’)?, and 
|2| = a/22 +492. 
All theorems of §§1-3 are valid. 
We now define the new multiplication in C’, which will make it a field. 
Definition 1. 
If z= (2, y) and z = (a’, y’), then zz’ = (az! — yy’, zy’ + yz’). 

Theorem 1. E? = C is a field, with zero element 0 = (0,0) and unity 1 = 
(1, 0), under addition and multiplication as defined above. 


Proof. We only must show that multiplication obeys Axioms I-VI of the field 
axioms. Note that for addition, all is proved in Theorem 1 of §§1-3. 

Axiom I (closure) is obvious from our definition, for if z and z’ are in C, so 
is zz’. 

To prove commutativity, take any complex numbers 


z= (2, y) and z = (2’, y’) 


1 This terminology is solely traditional. Actually, there is nothing “imaginary” about 
(0, y), no more than about (x, 0), or (a, y). 
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and verify that zz’ = z'z. Indeed, by definition, 
22! = (aa’ — yy’, cy’ + yz’) and 2'2z = (a’'x4 —-y'y, z'y+y'2); 


but the two expressions coincide by the commutative laws for real numbers. 
Associativity and distributivity are proved in a similar manner. 

Next, we show that 1 = (1, 0) satisfies Axiom IV(b), i-e., that lz = z for 
any complex number z = (2, y). In fact, by definition, and by axioms for FE’, 


lz = (1, 0) (a, y) = (1a — Oy, ly+ Ox) = (x —0, y+ 0) = (a, y) = z. 


It remains to verify Axiom V(b), i.e., to show that each complex number 
z = (a, y) ¥ (0, 0) has an inverse z—+ such that zz—! = 1. It turns out that 
the inverse is obtained by setting 


Jz|?° |z/P 7 
2 


2 2 2 
32 (2 4 Bw ey (BHF goat 
a= (Fat ie pp tip ee 


In fact, we then get 


since x? + y? = |z|?, by definition. This completes the proof. O 
Corollary 1. i? = —1; i.e., (0, 1)(0, 1) = (1, 0). 
Proof. By definition, (0, 1)(0, 1) = (0-0—1-1,0-1+4+1-0) =(-1, 0). 


Thus C has an element i whose square is —1, while E! has no such element, 
by Corollary 2 in Chapter 2, 8§1—4. This is no contradiction since that corollary 
holds in ordered fields only. It only shows that C' cannot be made an ordered 
field. 

However, the “real points” in C’ form a subfield that can be ordered by 
setting 

(x, 0) < (2, 0) iffe <2’ in FE’ 2 


Then this subfield behaves exactly like E‘.° Therefore, it is customary not to 
distinguish between “real points in C” and “real numbers,” identifying (x, 0) 
with x. With this convention, E! simply is a subset (and a subfield) of C. 
Henceforth, we shall simply say that “x is real” or “x € E!” instead of “x = 
(x, 0) is a real point.” We then obtain the following result. 


Theorem 2. Every z € C has a unique representation as 
z=24+ yi, 
? The proof is left as an exercise (Problem 1’ below). 


3 This can be made precise by using the notion of isomorphism (see Basic Concepts of 
Mathematics, Chapter 2, §14). We shall not go deeper into this topic here. 
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where x and y are real andi = (0, 1). Specifically, 
2=e- yi if 2 = Ge, y)- 


Proof. By our conventions, x = (x, 0) and y = (y, 0), so 
z+ yt = (x, 0) + (y, 0)(0, 1). 


Computing the right-hand expression from definitions, we have for any x, y € 
FE! that 


x+yi=(z,0)+ (y-0-0-1, y-14+0-1) = (2, 0) + (0, y) = (2, y). 


Thus (2, y) =2+ yi for any x, y € E'. In particular, if (x, y) is the given 
number z € C of the theorem, we obtain z = (x, y) = x + yi, as required. 
To prove uniqueness, suppose that we also have 


z=a2'+y't with x’ = (2’, 0) and y’ = (7, 0). 


Then, as shown above, z = (2’, y’). Since also z = (x, y), we have (x, y) = 
(x’, y’), i-e., the two ordered pairs coincide, and so x = 2’ and y = y’ after 
all. O 


Geometrically, instead of Carte- 
sian coordinates (x, y), we may also 
use polar coordinates r, 0, where 


r=Va?t+y?=|z| 


and @ is the (counterclockwise) rota- 
tion angle from the x-axis to the di- 


rected line Oe: see Figure 6. Clearly, 
z is uniquely determined by r and 86, 
but @ is not uniquely determined by 
z; indeed, the same point of E? results if 6 is replaced by 0+2nz (n = 1, 2, ...). 
(If z = 0, then @ is not defined at all.) The values r and @ are called, respec- 
tively, the modulus and argument of z = (x, y). By elementary trigonometry, 
x =rcosé and y=rsin@. Substituting in z = x + yi, we obtain the following 
corollary. 


FIGURE 6 


Corollary 2. z= r(cos@+isin@) (trigonometric or polar form of z). 


Problems on Complex Numbers 


1. Complete the proof of Theorem 1 (associativity, distributivity, etc.). 
1’. Verify that the “real points” in C form an ordered field. 
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. Prove that. zz = |z|?. Deduce that 2—! = z/|z|? if z 4 0.* 
. Prove that 


gt2?=74+2' and zz! =Z- 2’. 


Hence show by induction that 


nm nm 
= (Z)”, n= iF 2, SRI and S aye? _ ) nz. 


. Define 


e” = cos6 + isin. 


Describe e® geometrically. Is |e*’| = 1? 


. Compute 
Le 2s 

(a) 

(b) (1 + 22)(3 — 2); and 
e+ 14 
— FE}. 

erie 


Do it in two ways: (i) using definitions only and the notation (x, y) for 
x + yi; and (ii) using all laws valid in a field. 


. Solve the equation (2, —1)(x, y) = (3, 2) for x and y in E?. 
4 GE 


z=r(cos@+isin6), 
2’ =1r'(cos@’ + isin 6’), and 
2 =r"'(cos 6” + isin 6”) 
as in Corollary 2. Prove that z = 2/2” if 


p= |z|—r'r", ie, |Z 2"|=\2| le"|, and @=6' +6". 
— 
Discuss the following statement: To multiply z’ by z’’ means to rotate 02’ 


counterclockwise by the angle 0” and to multiply it by the scalar r” = 
|z’’|. Consider the cases 2’ =i and 2” = —1. 
[Hint: Remove brackets in 

r(cos@ +isin0@) =r’(cos@’ + isin’) - r”’ (cos 0” + isin 0”) 


and apply the laws of trigonometry. | 


. By induction, extend Problem 7 to products of n complex numbers, and 


derive de Moivre’s formula, namely, if z = r(cos@ +isin@), then 


z” =r"(cos(n0) +isin(né)). 


4 Recall that Z means “conjugate of z.” 
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Use it to find, for n = 1, 2,..., 
1 
a) a" b) (1+7)”; 6) —— =; 
(a) (b) (1 +4) (c) asta" 
9. From Problem 8, prove that for every complex number z ¥ 0, there are 
exactly n complex numbers w such that 
we =e 


they are called the nth roots of z. 
[Hint: If 
z=r(cos@+isin@) and w =r’ (cos@’ +isin6’), 


the equation w” = z yields, by Problem 8, 
(’)" =r and nf’ = 20, 


and conversely. 
While this determines r’ uniquely, 9 may be replaced by 6+ 2kz without affecting 


z. Thus 
6+ 2k 
ee aL 
n 
Distinct points w result only from k = 0, 1, ...,2 —1 (then they repeat cyclically). 
Thus n values of w are obtained.] 
10. Use Problem 9 to find in C 
(a) all cube roots of 1; (b) all fourth roots of 1. 


Describe all nth roots of 1 geometrically. 


*89. Vector Spaces. The Space C’”. Euclidean Spaces 


I. We shall now follow the pattern of E” to obtain the general notion of a 
vector space (just as we generalized E! to define fields). 

Let V be a set of arbitrary elements (not necessarily n-tuples), called “vec- 
tors” or “points,” with a certain operation (call it “addition,” +) somehow 
defined in V. Let F be any field (e.g., E' or C); its elements will be called 
scalars; its zero and unity will be denoted by 0 and 1, respectively. Suppose 
that yet another operation (“multiplication of scalars by vectors”) has been 
defined that assigns to every scalar c € F and every vector x € V a certain 
vector, denoted cx or xc and called the c-multiple of x. Furthermore, sup- 
pose that this multiplication and addition in V_ satisfy the nine laws specified 
in Theorem 1 of 881-3. That is, we have closure: 


(Va,yEV) (Vee F) x+yeVandcreV. 
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Vector addition is commutative and associative. There is a unique zero-vector, 
0, such that 
(VaEeV) £+0=2, 


and each x € V has a unique inverse, —x, such that 
a +(—-a) =0. 
We have distributivity: 
a(x + y) =ax+ay and (a+ b)x = ax + ba. 


Finally, we have 
ae 


and 


(ab)x = a(ba) 


(a,be F;2,yEV). 

In this case, V together with these two operations is called a vector space 
(or a linear space) over the field F’; F is called its scalar field, and elements of 
F are called the scalars of V. 


Examples. 
(a) E” is a vector space over E! (its scalar field). 


(a’) R”, the set of all rational points of E” (i.e., points with rational coordi- 
nates) is a vector space over R, the rationals in E'. (Note that we could 
take R as a scalar field for all of E”; this would yield another vector 
space, E” over R, not to be confused with E” over E', i.e., the ordinary 
E”.) 

(b) Let F' be any field, and let F'” be the set of all ordered n-tuples of elements 
of F’, with sums and scalar multiples defined as in E” (with F' playing 
the role of E'). Then F is a vector space over F (proof as in Theorem 1 
of §§1-3). 

(c) Each field F is a vector space (over itself) under the addition and multi- 


plication defined in F’. Verify! 


(d) Let V be a vector space over a field F’, and let W be the set of all possible 
mappings 
f:Av-~V 


from some arbitrary set A 4 ( into V. Define the sum f + g of two such 
maps by setting 


(f +.9)(x) = f(x) +9(2) for alla € A." 


1 Here “f+g” must be treated as one letter (function symbol); “(f+g)(x)” means “h(2),” 
where h = f +4; similarly for such symbols as af, etc. 
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Similarly, given a € F' and f € W, define the map af by 
(af) (a) = af(z). 


Under these operations, W is a vector space over the same field F’', with 
each map f: A > V treated as a single “vector” in W. (Verify!) 


Vector spaces over E! (respectively, C) are called real (respectively, complex) 
linear spaces. Complex spaces can always be transformed into real ones by 
restricting their scalar field C to E! (treated as a subfield of C). 


II. An important example of a complex linear space is C”, the set of all 
ordered n-tuples 


oS Pig ota iy) 


of complex numbers xx, (now treated as scalars), with sums and scalar multiples 
defined as in E”. In order to avoid confusion with conjugates of complex 
numbers, we shall not use the bar notation x for a vector in this section, 
writing simply x for it. Dot products in C” are defined by 


a oe > Boas 
k=1 


where y;, is the conjugate of the complex number y; (see §8), and hence a scalar 
in C. Note that 7, = yr if yy € E'. Thus, for vectors with real components, 


rey So Kye; 
k=1 


as in £”. The reader will easily verify (exactly as for E”) that, for x, y € C” 
and a, b € C, we have the following properties: 


(i) «-y €C; thus z-y isa scalar, not a vector. 
(ii) «-a2 € E', and x- x > 0; moreover, «- x = 0 iff « = 0. (Thus the dot 
product of a vector by itself is a real number > 0.) 
(iii) «-y = Y-@ (= conjugate of y- x). Commutativity fails in general. 
(iv) (ax) - (by) = (ab) (x+y). Hence (iv’) (ax) -y = a(x-y) = x- (ay). 
(v) (wt+ty)-z=a@-2+y-zand (v’) z-(et+y)=2z-a4+2-y. 
Observe that (v’) follows from (v) by (iii). (Verify!) 
IIT. Sometimes (but not always) dot products can also be defined in real or 
complex linear spaces other than £” or C”, in such a manner as to satisfy the 
laws (i)-(v), hence also (v’), listed above, with C replaced by E' if the space 


is real. If these laws hold, the space is called Euclidean. For example, E” is a 
real Euclidean space and C” is a complex one. 


88 Chapter 3. Vector Spaces. Metric Spaces 


In every such space, we define absolute values of vectors by 


|e) = «/an - a. 


(This root exists in E' by formula (ii).) In particular, this applies to E” 
and C”. Then given any vectors x, y and a scalar a, we obtain as before the 
following properties: 


(a’) |x| > 0; and |x| = 0 iff « = 0. 


(b’) Jaa| = al [2]. 
(c’) Triangle inequality: |x + y| < |x| + |y]. 
(d’) Cauchy-Schwarz inequality: |x -y| < |x| |y|, and |a-y| = |a||y| iff x || y 


(i.e., 2 = ay or y = az for some scalar a). 


We prove only (d’); the rest is proved as in Theorem 4 of §81-3. 

If x-y = 0, all is trivial, so let z = x-y =rc #0, where r = |x-y| and c has 
modulus 1, and let y’ = cy. For any (variable) t € E', consider |tz + y’|. By 
definition and (v), (iii), and (iv), 


jt +y' |? = (te +y')- (ta +y’) 
=te-tat+y’-tatta-y +y'-y’ 
=P(ax-a)+t(y!-2)+t(a-y') +(y'-y’) 
since t = t. Now, since cé = 1, 
fa =o (cy) = (ex) goa cre=r= ley), 
Similarly, 
ycan-ysTor=|c-yl,o-c=|s)*, and yy! =y-y=lyl’. 
Thus we obtain 


(VteE") |te+eyl? = t?|a|? + 2¢|a - yl + |yl’. (1) 


Here |x|, 2|x- y|, and |y|? are fixed real numbers. We treat them as coeffi- 
cients in t of the quadratic trinomial 


f(t) =P lal? + 2ela - y| + |yl?. 
Now if x and y are not parallel, then cy 4 —tx, and so 
lta + cy| = |tr + y’| 40 


for any t € E‘. Thus by (1), the quadratic trinomial has no real roots; hence 
its discriminant, 
A|x- yl? — 4(\2| |yl)?, 


is negative, so that |x - y| < |x| |y|. 


*§9. Vector Spaces. The Space C”. Euclidean Spaces 89 


If, however, x || y, one easily obtains |x - y| = |x| |y|, by (b’). (Verify.) 


Thus |x- y| = |x| |y| or |x-y| < |x| |y| according to whether z || y or not. 


In any Euclidean space, we define distances by p(x, y) = |x — y|. Planes, 
lines, and line segments are defined exactly as in E”. Thus 


line Dg = {p+ t(q—p) |t € E’} (in real and complex spaces alike). 


Problems on Linear Spaces 


1. Prove that F” in Example (b) is a vector space, i.e., that it satisfies all 
laws stated in Theorem 1 in §§1-3; similarly for W in Example (d). 


2. Verify that dot products in C” obey the laws (i)—(v’). Which of these 
laws would fail if these products were defined by 


Lrey= So reyn instead of x-y = So edn? 
k=1 ct 


How would this affect the properties of absolute values given in (a’)—(d’)? 


3. Complete the proof of formulas (a’)—(d’) for Euclidean spaces. What 
change would result if property (ii) of dot products were restated as 


“7. ¢ >0and0-0=0"? 


4. Define orthogonality, parallelism and angles in a general Euclidean space 
following the pattern of §81-3 (text and Problem 7 there). Show that 
u = 0 iff u is orthogonal to all vectors of the space. 


5. Define the basic unit vectors e, in C” exactly as in E”, and prove 
Theorem 2 in §§1-3 for C” (replacing E+ by C). Also, do Problem 5(a) 
of 881-3 for C”. 


6. Define hyperplanes in C” as in Definition 3 of §84-6, and prove 
Theorem 1 stated there, for C”. Do also Problems 4-6 there for C” 
(replacing E! by C) and Problem 4 there for vector spaces in general 
(replacing E! by the scalar field F). 


7. Do Problem 3 of §§4—6 for general Euclidean spaces (real or complex). 
Note: Do not replace E' by C in the definition of a line and a line 
segment. 


8. A finite set of vectors B = {x1, ..., Ym} in a linear space V over F is 
said to be independent iff 


(Vay, Q2,.--, Gm € F) (Sain 0 => a, = a9 =--: =Am 0). 
i=l 


Prove that if B is independent, then 
(i) 0¢ B; 
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(ii) each subset of B is independent (( counts as independent); and 


(iii) if for some scalars a;, 5; € F, 


m mm 

y Ayr = y ae 

i=l i=l 
then a, = 6,74 = 1,2) ..., 7% 


9. Let V be a vector space over F' and let A C V. By the span of A in V, 
denoted span(A), is meant the set of all “linear combinations” of vectors 
from A, i.e., all vectors of the form 


> aes a; € F, £,€ A,m€e N.? 

i=1 
Show that span(A) is itself a vector space V’ C V (a subspace of V) 
over the same field F’, with the operations defined in V. (We say that 
A spans V'.) Show that in E” and C”, the basic unit vectors span the 
entire space. 
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By a normed linear space (briefly normed space) is meant a real or complex 
vector space E£ in which every vector x is associated with a real number |z\, 
called its absolute value or norm, in such a manner that the properties (a’)—(c’) 
of §9 hold.! That is, for any vectors 2, y € E and scalar a, we have 


(i) |a| > 0; 
(i') |x| = 0 iff x = 0; 


(i) lag] = |a| |a|; and 


(iii) |x + y| < |z| + |y| (triangle inequality). 


Mathematically, the existence of absolute values in EF amounts to that of a 
map (called a norm map) x > |x| on E, i.e., a map y: E > E', with function 
values y(x) written as |x|, satisfying the laws (i)—(iii) above. Often such a map 
can be chosen in many ways (not necessarily via dot products, which may not 
exist in F), thus giving rise to different norms on E. Sometimes we write ||| 
for |x| or use other similar symbols. 


Note 1. From (iii), we also obtain |x — y| > ||a| — |y|| exactly as in E”. 
2 If A = 0, then span(A) = {0} by definition. 


| Roughly, it is a vector space (over E! or C) in which “well-behaved” absolute values are 
defined, resembling those in E”. 
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Examples. 


(A) Each Fuclidean space (§9), such as E” or C”, is a normed space, with 


norm defined by 
[a Saree 


as follows from formulas (a’)-(c’) in §9. In E” and C”, one can also 


equivalently define 
le] = 4/0 lee”, 
k=1 


where x = (21,..., Zn). This is the so-called standard norm, usually 
presupposed in £” (C”). 


” 


(B) One can also define other, “nonstandard,” norms on E” and C”. For 


example, fix some real p > 1 and put 


A L. 

Pp 

lye (> ul | 
k=1 


One can show that |x|, so defined satisfies (i)—(iii) and thus is a norm 
(see Problems 5-7 below). 


(C) Let W be the set of all bounded maps 
f: AoE 
from a set A # ( into a normed space F, i.e., such that 
(Vite A) [fl <e 


for some real constant c > 0 (dependent on f but not on t). Define f +g 
and af as in Example (d) of 89 so that W becomes a vector space. Also, 
put 


Il fl] = sup |f(@)], 
teA 


i.e., the supremum of all |f(t)|, with t € A. Due to boundedness, this 
supremum exists in E', so ||f|| € E*. 


It is easy to show that ||f|| is a norm on W. For example, we verify 
(iii) as follows. 
By definition, we have for f, g €¢ W and wz € A, 


I(f +9)(@)| = [F(@) + 9(2)| 
< |f(x)| + |o(x)| 
< sup | f(t)| + sup |g(#)| (1) 
tEA tEA 


= ||FIl + llgll- 
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(The first inequality is true because (iii) holds in the normed space E to 
which f(x) and g(x) belong.) By (1), || f|] + ||g|| is an upper bound of all 
expressions |(f + g)(x)|, x € A. Thus 


FI + Ilgll = sup (f+ 9)(@)l = IF + all 


Note 2. Formula (1) also shows that the map f + g is bounded and hence 
is a member of W. Quite similarly we see that af € W for any scalar a and 
f €© W. Thus we have the closure laws for W. The rest is easy. 


In every normed (in particular, in each Euclidean) space E, we define dis- 
tances by 


p(z, y)=|x—y| forallz, ye Ek. 


Such distances depend, of course, on the norm chosen for EF; thus we call them 
norm-induced distances. In particular, using the standard norm in E” and C” 


(Example (A)), we have 
ple, y) = 4) >) lex — yel?. 
k=1 


Using the norm of Example (B), we get 


1 
n = 


p(z, y) = (> Ite — is!) : 


k=1 


instead. In the space W of Example (C), we have 
pf, 9) = Ilf — gll = sup If(x) — g(w)I- 


Proceeding exactly as in the proof of Theorem 5 in 881-3, we see that norm- 
induced distances obey the three laws stated there. (Verify!) Moreover, by 
definition, 


p(at+u, yt+u) = |(a@+u)—(yt+u)| = |@— yl = (a, 9). 
Thus we have 
p(x, y) = p(x + u, y+ u) for norm-induced distances; (2) 


i.e., the distance p(x, y) does not change if both x and y are “translated” by 
one and the same vector u. We call such distances translation-invariant. 
A more general theory of distances will be given in §$11ff. 
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Problems on Normed Linear Spaces 


1. Show that distances in normed spaces obey the laws stated in Theorem 5 


of §$1-3. 
2. Complete the proof of assertions made in Example (C) and Note 2. 
3. Define |x| = x, for x = (a1, ..., Z,) nC” or BE”. Is thisa norm? Which 


(if any) of the laws (i)—(iii) does it obey? How about formula (2)? 


4. Do Problem 3 in 884-6 for a general normed space EF, with lines defined 
as in £” (see also Problem 7 in §9). Also, show that contracting se- 
quences of line segments in EF are f-images of contracting sequences of 
intervals in E'. Using this fact, deduce from Problem 11 in Chapter 2, 
888-9, an analogue for line segments in E, namely, if 


Ll Ga, On| 2 Dita tay Dye |, n=1, Pickens 


then 


A) Lian, bn] FO. 
n=1 


5. Take for granted the lemma that 


qi/Ppl/d < a ate 6 
P 4 

if a, b, p,q € E' with a, b > 0 and p, q > 0, and 

1 1 

Sige ai. 

P 4 
(A proof will be suggested in Chapter 5, 86, Problem 11.) Use it to 
prove Holder’s inequality, namely, if p > 1 and : 4 ; = 1, then 


i 1 
p q 
a [Zeal < i ul bp sl") for any Lx, YR EC. 
k=1 k=1 k=1 


[Hint: Let 
L 
q 


nm 1 mr 
Pp 
A= (So leul?)” ana B= (5 ml) 
k=1 k=1 


If A=0or B=0, then all x; or all yz, vanish, and the required inequality is trivial. 
Thus assume A #0 and B40. Then, setting 


P q 
ag — Wea ana b — walt 
Ba 
in the lemma, obtain 
Pp q 
|rnYKl < lel? | lye 6 ree Dy cc ae 
AB pAP qB4 
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Now add up these n inequalities, substitute the values of A and B, and simplify.] 


. Prove the Minkowski inequality, 


= n 1 ds dl 
Pp P Pp 
(Slax +su0") < (lea!) + (Shel) 
| eat | k=] R=) 


for any real p > 1 and xz, yr EC. 
[Hint: If p = 1, this follows by the triangle inequality in C. If p > 1, let 


A=S° |x + unl? £0. 
k=1 


(if A = 0, all is trivial.) Then verify (writing “D>” for ““SCy_,” for simplicity) 


A=)J_|ee t+ yellte tyel?-? < >— |eelle + yal? > +52 lyellen + yel? 


Now apply Hoélder’s inequality (Problem 5) to each of the last two sums, with gq = 
p/(p — 1), so that (p — 1)q = p and 1/p = 1-—1/gq. Thus obtain 


A< (Slew)? (lex + aml”) * + (lel)? (To lan + vel?) 


Then divide by Ag = (do ltr + yal?) and simplify.] 


i 
q 


. Show that Example (B) indeed yields a norm for C” and E”. 


[Hint: For the triangle inequality, use Problem 6. The rest is easy.] 


. A sequence {z,,} of vectors in a normed space F (e.g., in E” or C”) is 


said to be bounded iff 


(Sce€ E1) (Vm) |tm| <c, 


ice., iff sup,,, |@m| is finite. 


Denote such sequences by single letters, x = {tm}, y = {Ym}, ete., 
and define 


cty={&%m+ Ym}, and ax = {az,,} for any scalar a. 


Also let 


|z] = sup |m|. 
m 


Show that, with these definitions, the set M of all bounded infinite 
sequences in EF’ becomes a normed space (in which every such sequence 


is to be treated as a single vector, and the scalar field is the same as 
that of E). 
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§11. Metric Spaces 


I. In 881-3, we defined distances p(x, y) for points z, y in E” using the 
formula 


nm 


o(@, 9) = 4] > (an — ye)? = |B - 9. 


k=1 


This actually amounts to defining a certain function p of two variables x, y © 
E”. We also showed that p obeys the three laws of Theorem 5 there. (We call 
them metric laws.) 

Now, as will be seen, such functions p can also be defined in other sets, 
using quite different defining formulas. In other words, given any set S 4 0 
of arbitrary elements, one can define in it, so to say, “fancy distances” p(x, y) 
satisfying the same three laws. It turns out that it is not the particular formula 
used to define p but rather the preservation of the three laws that is most 
important for general theoretical purposes. 

Thus we shall assume that a function p with the same three properties has 
been defined, in some way or other, for a set S 40, and propose to study the 
consequences of the three metric laws alone, without assuming anything else. 
(In particular, no operations other than p, or absolute values, or inequalities <, 
need be defined in S.) All results so obtained will, of course, apply to distances 
in E” (since they obey the metric laws), but they will also apply to other cases 
where the metric laws hold. 

The elements of S (though arbitrary) will be called “points,” usually denoted 
by p,q, x, y, 2 (sometimes with bars, etc.); p is called a metric for S. We 
symbolize it by 


p:SxS3E 
since it is function defined on S x S' (pairs of elements of S) into E'. Thus we 
are led to the following definition. 
Definition 1. 


A metric space is a set S 4 ( together with a function 
pSxsSakr 


(called a metric for S') satisfying the metric laws (axioms): 
For any x, y, and z in S, we have 


(i) p(x, y) = 0, and (i’) p(x, y) =O iffr=y; 
(ii) p(x, y) = p(y, x) (symmetry law); and 
(iii) p(x, z) < p(x, y) + ply, z) (triangle law). 


96 Chapter 3. Vector Spaces. Metric Spaces 


Thus a metric space is a pair (S, p), namely, a set S and a metric p for it. 
In general, one can define many different metrics 


BO iR oe 


for the same S. The resulting spaces 


(Oy Py OD) CaP My a 


then are regarded as different. However, if confusion is unlikely, we simply 
write S for (5, p). We write “p € (S, p)” for “p € S with metric p,” and 
“A C (S, p)” for “A C S in (S, p).” 


Examples. 


(1) In E”, we always assume 
p(z, y) =|z—y| (the “standard metric” ) 
unless stated otherwise.| By Theorem 5 in §§1-3, (E”, p) is a metric 
space. 


(2) However, one can define for £” many other “nonstandard” metrics. For 
example, 


n 1/p 
#@ = (So lre—wl?) for any real p> 1 
k=1 


likewise satisfies the metric laws (a proof is suggested in §10, Problems 5-— 
7); similarly for C”. 


(3) Any set S 4 J can be “metrized” (i.e., endowed with a metric) by setting 


p(t, y) = life Ay, and p(az, x) =0. 
(Verify the metric laws!) This is the so-called discrete metric. The space 


(S, p) so defined is called a discrete space. 


(4) Distances (“mileages”) on the surface of our planet are actually measured 
along circles fitting in the curvature of the globe (not straight lines). One 
can show that they obey the metric laws and thus define a (nonstandard) 
metric for S = (surface of the globe). 


(5) A mapping f: A > E! is said to be bounded iff 


(AK CE’) (VxeEA) |f(2)| < K. 


' Similarly in other normed spaces (§10), such as C”. (A reader who has omitted the 
“starred” §10 will consider E” only.) 
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For a fixed A 4 0), let W be the set of all such maps (each being treated 
as a single “point” of W). Metrize W by setting, for f, g € W, 


p(f, 9) = sup | f(x) — g(x)]- 
ZEA 
(Verify the metric laws; see a similar proof in $10.) 


II. We now define “balls” in any metric space (S, p). 
Definition 2. 


Given p € (5, p) and a real « > 0, we define the open ball or globe with 
center p and radius ¢ (briefly “e-globe about p”), denoted 


Gp or G,(e€) or G(p;e), 
to be the set of allx € S such that 
p(x, p) <e. 
Similarly, the closed ¢-globe about p is 
Gp = Gp(e) = {x € S| pla, p) < e}. 
The e-sphere about p is defined by 
Sp(é) = {x € S| pla, p) = €}. 


Note. An open globe in E° is an ordinary solid sphere (without its surface 
S»p(€)), as known from geometry. In E£?, an open globe is a disc (the interior 
of a circle). In E', the globe G,(e) is simply the open interval 


(p—e, p+e), 


while G,(e) is the closed interval 
[p —é&, p+ e]. 


The shape of the globes and spheres depends on the metric p. It may become 
rather strange for various unusual metrics. For example, in the discrete space 
(Example (3)), any globe of radius < 1 consists of its center alone, while G,,(2) 
contains the entire space. (Why?) See also Problems 1, 2, and 4. 


III. Now take any nonempty set 
AGS, 9): 


The distances p(x, y) in S are, of course, also defined for points of A (since 
A CS), and the metric laws remain valid in A. Thus A is likewise a (smaller) 
metric space under the metric p “inherited” from S; we only have to restrict 
the domain of p to A x A (pairs of points from A). The set A with this metric 
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is called a subspace of S. We shall denote it by (A, p), using the same letter p, 
or simply by A. Note that A with some other metric p’ is not called a subspace 
of (S, p). 

By definition, points in (A, ) have the same distances as in (5, p). However, 
globes and spheres in (A, p) must consist of points from A only, with centers 
in A. Denoting such a globe by 


Gt) = {2 € A| ple, p) <e}, 


we see that it is obtained by restricting Gp(e) (the corresponding globe in S) 
to points of A, i.e., removing all points not in A. Thus 


G36) = ANG (6); 


similarly for closed globes and spheres. AM G'p(e) is often called the relativized 
(to A) globe G,(e). Note that p € Gj(e) since p(p, p) = 0 < «, and pe A. 

For example, let R be the subspace of E! consisting of rationals only. Then 
the relativized globe G}(¢) consists of all rationals in the interval 


Gy(é) = (p — €, pe), 
and it is assumed here that p is rational itself. 


IV. A few remarks are due on the extended real number system E* (see 
Chapter 2, $13). As we know, E* consists of all reals and two additional 
elements, too, with the convention that —oo < x < +00 for all « € E!. 
The standard metric p does not apply to E*. However, one can metrize E* in 
various other ways. The most common metric p’ is suggested in Problems 5 and 
6 below. Under that metric, globes turn out to be finite and infinite intervals 
in EB”. 

Instead of metrizing E*, we may simply adopt the convention that intervals 
of the form 

(a, +00] and [—oo, a), a € E’, 


will be called “globes” about +oo and —oo, respectively (without specifying 
any “radii”). Globes about finite points may remain as they are in E'. This 
convention suffices for most purposes of limit theory. We shall use it often (as 
we did in Chapter 2, $13). 


Problems on Metric Spaces 
The “arrowed” problems should be noted for later work. 


1. Show that E? becomes a metric space if distances p(Z, 7) are defined 
by 


(a) p(Z, 9) = |e1 — yi| + |z2 — ye or 
(b) p(Z, 7) = max{|x1 — y1|, |v2 — yal}, 
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where £ = (21, Z2) and ¥ = (y1, y2). In each case, describe G9(1) 
and S5(1). Do the same for the subspace of points with nonnegative 
coordinates. 


. Prove the assertions made in the text about globes in a discrete space. 


Find an empty sphere in such a space. Can a sphere contain the entire 
space? 


3. Show that p in Examples (3) and (5) obeys the metric axioms. 


=>5. 


=>6. 


. Let M be the set of all positive integers together with the “point” oo. 


Metrize M by setting 
Te ; 1 
pin, a) = — — -|, with the convention that — = 0. 
min oo 


Verify the metric axioms. Describe Go($), Soo($), and Gi (1). 


Metrize the extended real number system E* by 


p(x, y) = |f(z) -—f@)|, 


where the function 
f: BF 3 [-1,] 


onto 


is defined by 


f(x} if x is finite, f(—oo) = —1, and f(+oo) = 1. 


_. 2 

~~ 14 |2| 
Compute p'(0, +00), p’(0, —00), p"(—0o, +00), p’(0, 1), p'(1, 2), and 
p'(n, +00). Describe Go(1), Gyo0(1), and G_.(). Verify the metric 
axioms (also when infinities are involved). 


In Problem 5, show that the function f is one to one, onto |[—1, 1], and 
increasing; 1.€., 

x <2’ implies f(x) < f(x’) for z, x’ € E*. 
Also show that the f-image of an interval (a, b) C E* is the interval 
(f(a), f(b)). Hence deduce that globes in E* (with p’ as in Problem 5) 


are intervals in E* (possibly infinite). 
[Hint: For a finite x, put 


Solving for x (separately in the cases x > 0 and x < 0), show that 


Wye(-1D) ©=f"W= TH 


thus x is uniquely determined by y, i.e., f is one to one and onto—each y € (—1, 1) 
corresponds to some x € E!. (How about +17) 
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To show that f is increasing, consider separately the three cases x < 0 < 2’, 
x<a2’<Oand0<~2z <2’ (also for infinite x and z’).| 


. Continuing Problems 5 and 6, consider (E', p’) as a subspace of (E*, p’) 


with p’ as in Problem 5. Show that globes in (£1, p’) are exactly all 
open intervals in E*. For example, (0, 1) isa globe. What are its center 
and radius under p’ and under the standard metric p? 


. Metrize the closed interval [0, +00] in E* by setting 


1 1 
ie lay 


with the conventions 1 + (+00) = +00 and 1/(+c00) = 0. Verify the 
metric axioms. Describe G,(1) for arbitrary p > 0. 


p(z, y) = | 


. Prove that if p is a metric for S, then another metric p’ for S is given 


by 
(i) p’(x, y) = min{1, p(x, y)}; 
Gi) p'(@, ) = A. 


In case (i), show that globes G’,(e) of radius e < 1 are the same under p 
and p’. In case (ii), prove that any G'p(e) in (S, p) is also a globe G,(e’) 
in (S, p’) of radius 

fa 

1+e’ 

and any globe of radius ¢’ < 1 in (S, p’) is also a globe in (S, p). (Find 
the converse formula for € as well!) 
[Hint for the triangle inequality in (ii): Let a = p(x, z), b= p(a, y), and c= p(y, z), 
so that a<b+c. The required inequality is 


a b 1 c 
lt+a7~1+0b0 1+c’ 


Simplify it and show that it follows from a < b+ c.] 


Prove that if (X, p’) and (Y, p”) are metric spaces, then a metric p for 
the set X x Y is obtained by setting, for 71, v2 © X and yj, yo EY, 


(i) p((@1, yr), (@2, yo)) = max{p"(x1, ©2), p"(y1, Yo) }; oF 


(ii) p((1, yi); (xo, y2)) — p' (x1, r2)? a p(y, yo)? . 
[Hint: For brevity, put p)5 = p’(x1, £2), p> = p’’(y1, y2), etc. The triangle inequal- 


ity in (ii), 
y (6143)? + (3)? S (P12)? + (Pil)? + y/ (P93)? + (0293)? » 


is verified by squaring both sides, isolating the remaining square root on the right 
side, simplifying, and squaring again. Simplify by using the triangle inequalities valid 
in X and Y, ie., 

P13 S Piz + P23 and pz < pyz + p23. 
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Reverse all steps, so that the required inequality becomes the last step.] 
11. Prove that 
lp(y, 2) — plz, 2)| < plz, y) 


in any metric space (S, p). 
[Caution: The formula p(x, y) = |x—y|, valid in E”, cannot be used in (S, p). Why?| 


12. Prove that 
p(p1; Pa) + plp2, 3) ++->+ p(Pn=1; Pn) = P(P1, Pn): 


[Hint: Use induction.] 
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I. Let A be an open globe in (5, p) or an open interval (a, b) in E”. Then 
every p € A can be enclosed in a small globe G,(d) C A (Figures 7 and 8). 
(This would fail for “boundary” points; but there are none inside an open Gy 
or (a, b).) 


ol 


FIGURE 7 FIGURE 8 


This suggests the following ideas, for any (S, p). 
Definition 1. 


A point p is said to be interior to a set A C (S, p) iff A contains some 
Gy; ie., p, together with some globe G,, belongs to A. We then also say 
that A is a neighborhood of p. The set of all interior points of A (“the 
interior of A”) is denoted A®. Note: 0° = @ and S° = 39.4 


Definition 2. 


A set A C (S, p) is said to be open iff A coincides with its interior 
(A° = A). Such are @ and S. 


1 Indeed, @ has no points at all, and hence no interior points; i.e., 0° is void. On the other 
hand, S contains any Gp. Thus any p is interior to 9; i.e., S° = S. 
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Examples. 


(1) As noted above, an open globe G,(r) has interior points only, and thus 
is an open set in the sense of Definition 2. (See Problem 1 for a proof.) 


(2) The same applies to an open interval (a, b) in E”. (See Problem 2.) 


(3) The interior of any interval in E” never includes its endpoints @ and 6. 
In fact, it coincides with the open interval (a, b). (See Problem 4.) 

(4) The set R of all rationals in E! has no interior points at all (R° = 0) 
because it cannot contain any G, = (p—eé,p+e). Indeed, any such 
G, contains irrationals (see Chapter 2, §§11-12, Problem 5), so it is not 
entirely contained in R. 


Theorem 1 (Hausdorff property”). Any two points p and q (p #q) in (S, p) 
are centers of two disjoint globes. 
More precisely, 


(Se>0) Gp(e)NG(e) = 0. 
Proof. As p# q, we have p(p, q) > 0 by metric axiom (i’). Thus we may put 


1 
E= 5p(p, a) > 0. 
It remains to show that with this ¢, G,(e)N G,(e) = 9. 
Seeking a contradiction, suppose this fails. Then there is « € G,(e) 1 Ga(e) 
so that p(p, x) < e and p(x, q) < «. By the triangle law, 


p(p, 2) < plp, x) + p(x, q) < e+e = 2¢; ie., pp, g) < 2e, 


which is impossible since p(p, q) = 2¢. UO 


/ \ OE 
a \ 
co en 
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armel ee 
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Note. A look at Figure 9 explains the idea of this proof, namely, to obtain 
two disjoint globes of equal radius, it suffices to choose ¢ < 4p(p, q). The 
reader is advised to use such diagrams in E? as a guide. 


II. We can now define closed sets in terms of open sets. 


2Named after Felix Hausdorff. 
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Definition 3. 


A set A C (S, p) is said to be closed iff its complement —A = S — A is 
open, i.e., has interior points only. 
That is, each p € —A (outside A) is in some globe G, C —A so that 


ANG, = 0. 


Examples (continued). 


(5) The sets 0 and S are closed, for their complements, S and @, are open, as 
noted above. Thus a set may be both closed and open (“clopen” ). 


(6) All closed globes in (S, p) and all closed intervals in E” are closed sets by 
Definition 3. Indeed (see Figures 9 and 10), if A = G,(r) or A = (4, 9), 
then any point p outside A can be enclosed in a globe G,(6) disjoint from 
A; so, by Definition 3, A is closed (see Problem 12). 


(7) A one-point set {q} (also called “singleton” ) in (S, ) is always closed, for 
any p outside {q} (p # q) is in a globe disjoint from {q} by Theorem 1. 
In a discrete space (§11, Example (3)), {q} is also open since it is an 
open globe, {q} = Gq(5) (why?); so it is “clopen.” Hence, in such a space, 
all sets are “clopen”. For p € A implies {p} = Gp(3) C A; similarly for 
—A. Thus A and —A have interior points only, so both are open. 


(8) The interval (a, b] in E' is neither open nor closed. (Why?) 


“III. (The rest of this section may be deferred until Chapter 4, $10.) 
Theorem 2. The union of any finite or infinite family of open sets A; (i € I), 


denoted 
U Aj, 
ie€l 


is open itself. So also is 


for finitely many open sets. (This fails for infinitely many sets A;; see Prob- 
lem 11 below.) 


Proof. We must show that any point p of A = LU, A; is interior to A. 
Now if p € U, Ai, p is in some Aj, and it is an interior point of A; (for A; 
is open, by assumption). Thus there is a globe 


Gy, C Ay C A; 


as required. 
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For finite intersections, it suffices to consider two open sets A and B (for 
n sets, all then follows by induction). We must show that each p € AN B is 
interior to AN B. 

Now as p € A and A is open, we have some G,(6’) C A. Similarly, there is 
G,(6”) C B. Then the smaller of the two globes, call it Gp, is in both A and 
B, so 

Gy, CATE 


and p is interior to AN B, indeed. 


Theorem 3. /f the sets A; (i € I) are closed, so is 
(\4i 
i€l 


(even for infinitely many sets). So also is 


for finitely many closed sets A;. (Again, this fails for infinitely many sets A;.) 
Proof. Let A =(),-; Ai. To prove that A is closed, we show that —A is open. 
Now by set theory (see Chapter 1, §§1-3, Theorem 2), 
~A=-()A:=UJ(-Ad, 
where the (—A;) are open (for the A; are closed). Thus by Theorem 2, —A is 
open, as required. 


The second assertion (as to U;_, A;) follows quite similarly. 
Corollary 1. A nonempty set A C (S, p) is open iff A is a union of open 
globes. 


For if A is such a union, it is open by Theorem 2. Conversely, if A is open, 
then each p € A is in some G, C A. All such G, (p € A) cover all of A, so 
ACU G,. Also, U G, C A since all G, are in A. Thus 


A= |J Gp. 


pEAa 


pEA pEA 


Corollary 2. Every finite set F in a metric space (S, p) is closed. 
Proof. If F = @, F is closed by Example (5). If F' 4 9, let 


F = {pi +++ Pn} = J {ps}. 


k=1 


Now by Example (7), each {p;,} is closed; hence so is F by Theorem 3. UO 
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Note. The family of all open sets in a given space (S, p) is denoted by G; 
that of all closed sets, by #. Thus “A € G” means that A is open; “A € F” 
means that A is closed. By Theorems 2 and 3, we have 


(VA,BeEG) AUBEGand ANBEG; 


similarly for F. This is a kind of “closure law.” We say that F and G are 
“closed under finite unions and intersections.” 

In conclusion, consider any subspace (A, p) of (S, p). As we know from 811, 
it is a metric space itself, so it has its own open and closed sets (which must 
consist of points of A only). We shall now show that they are obtained from 
those of (5, p) by intersecting the latter sets with A. 


Theorem 4. Let (A, p) be a subspace of (S, p). Then the open (closed) sets 
in (A, p) are exactly all sets of the form ANU, with U open (closed) in S. 


Proof. Let G be open in (A, p). By Corollary 1, G is the union of some open 
globes G* (i € I) in (A, pe). (For brevity, we omit the centers and radii; we 
also omit the trivial case G = 0.) 


As was shown in §11, however, G7 = AM G;, where G; is an open globe in 
(S, p). Thus 


G=JGi =Ul(4AnG) =4nUG, 


7 


by set theory (see Chapter 1, §§1-3, Problem 9). 
Again by Corollary 1, U = J; Gi is an open set in (5S, p). Thus G has the 
form 


ANUJGi=Anu, 


with U open in S, as asserted. 
Conversely, assume the latter, and let p € G. Then p € A and pe U. As 
U is open in (5, p), there is a globe G, in (S, p) such that p € G, CU. As 
p € A, we have 
pE ANG, CANU. 


However, AMG, is a globe in (A, p), call it G5. Thus 
pe G, CANU=G; 


i.e., p is an interior point of G in (A, p). We see that each p € G is interior to 
G, as a set in (A, p), so G is open in (A, p). 

This proves the theorem for open sets. Now let F’ be closed in (A, p). Then 
by Definition 3, A — F' is open in (A, p). (Of course, when working in (A, p), 
we replace S by A in taking complements.) Let G= A—F, so F = A—G, and 
G is open in (A, p). By what was shown above, G = ANU with U open in S. 
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F=A-G=A-(ANU)=A-U=AN(-U) 


by set theory. Here —U = S—U is closed in (S, p) since U is open there. Thus 
F = AN (-U), as required. 


The proof of the converse (for closed sets) is left as an exercise. 


=>2. 


Problems on Neighborhoods, Open and Closed Sets 


. Verify Example (1). 


[Hint: Given p € G,(r), let 
d6=r-—p(p,q)>0. (Why > 0?) 
Use the triangle law to show that 
x € Gy(d) => pla, gq) <r > aE G(r).] 
Check Example (2); see Figure 8. 
(Hint: If p € (G, 6), choose 6 less than the 2n numbers 
Pr —@y and by —pp, kK=1,..., 7; 


then show that G'5(d) C (4, b).] 


. Prove that if p € Gg(r) in EB”, then G(r) contains a cube [é, d] with 


ce #d and with center p. 

[Hint: By Example (1), there is Gp(6) C Gg(r). Inscribe in Gp(49) a cube of diagonal 
6. Find its edge-length (6/./n). Then use it to find the coordinates of the endpoints, 
é and d (given p, the center). Prove that [é, d] C Gp(6).] 


. Verify Example (3). 


[Hint: To show that no interior points of [a, b] are outside (a, b), let p ¢ (a, b). Then 
at least one of the inequalities a, < pz or py < by fails. (Why?) Let it be a1 < pi, 
say, SO pj < a4. 

Now take any globe Gj(6) about p and prove that it is not contained in [@, 0] 
(so p cannot be an interior point). For this purpose, as in Problem 3, show that 
Gp(6) D [é, d] with cy < pi < a1. Deduce that ¢ € Gp(5), but c ¢ [4, b]; so 
G5(6) £ (a, 8] 


. Prove that each open globe Gj(r) in E” is a union of cubes (which can 


be made open, closed, half-open, etc., as desired). Also, show that each 
open interval (a, b) 4 0 in E” is a union of open (or closed) globes. 
[Hint for the first part: By Problem 3, each p € Gg(r) is ina cube Cp C Gg(r). Show 
that Gg(r) =UCp.] 


. Show that every globe in E” contains rational points, i.e., those with 


rational coordinates only (we express it by saying that the set R” of 
such points is dense in E”); similarly for the set I” of irrational points 
(those with irrational coordinates). 


(Hint: First check it with globes replaced by cubes (@, d); see §7, Corollary 3. Then 
use Problem 3 above.| 
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ie 


10. 


11. 


12. 


*13. 
*14, 


*15. 


Prove that if  € Gg(r) in BE”, there is a rational point p (Problem 6) 
and a rational number 6 > 0 such that % € G5(6) C Gg(r). Deduce that 
each globe Gg(r) in E” is a union of rational globes (those with rational 
centers and radii). Similarly, show that G(r) is a union of intervals 
with rational endpoints. 

[Hint for the first part: Use Problem 6 and Example (1).] 


. Prove that if the points pi, ..., Pn in (S, p) are distinct, there is an 


€ > 0 such that the globes G(pz;¢) are disjoint from each other, for 
= 1, Bacay 


. Do Problem 7, with Gj(r) replaced by an arbitrary open set G # Q in 


E”. 
Show that every open set G 4 () in E” is infinite (“even uncountable; 


see Chapter 1, 89). 
[Hint: Choose Gg(r) C G. By Problem 3, G(r) D L{é, dj, a line segment.] 


Give examples to show that an infinite intersection of open sets may not 
be open, and an infinite union of closed sets may not be closed. 
[Hint: Show that 


and 


Verify Example (6) as suggested in Figures 9 and 10. 
[Hints: (i) For Gg(r), take 


d= p(p,q)—r>0. (Why > 0?) 


(ii) If p ¢ [@, b], at least one of the 2n inequalities a, < pz or pp < by fails (why?), 
say, p1 < a1. Take 6 = a1 — pj. 
In both (i) and (ii) prove that AM Gp(6) = @ (proceed as in Theorem 1).] 


Prove the last parts of Theorems 3 and 4. 


Prove that A®, the interior of A, is the union of all open globes contained 
in A (assume A° 4 ()). Deduce that A®° is an open set, the largest 
contained in A.? 


For sets A, B C (S, p), prove that 
(i) (ANB)? = A°n B®; 
(ii) (A°)° = A®; and 

(iii) if AC B then A® C B®, 


3 That is, the one that contains all other open subsets of A. 
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[Hint for (ii): A° is open by Problem 14.] 


16. Is A°U B® = (AU B)°? 
[Hint: See Example (4). Take A = R, B = E! — R]] 


17. Prove that if M and N are neighborhoods of p in (S, p), then 
(a) pEMNN; 
(b) MON is a neighborhood of p; 
*(c) so is M°; and 
(d) so also is each set P C S such that PD M or PDN. 
[Hint for (c): See Problem 14] 
18. The boundary of a set A C (S, p) is defined by 


bd A = —[A® U (—A)*); 
thus it consists of points that fail to be interior in A or in —A. 
Prove that the following statements are true: 
(i) S = A° Ubd AU (—A)?, all disjoint. 
(ii) bd S = 0, bd = 0. 
*(iii) A is open iff AN bd A = 9; A is closed iff A D bd A. 
(iv) In EB”, 
bd Ga(r) = bd G(r) = Sa(r) 
(the sphere with center p and radius r). Is this true in all metric 
spaces? 
[Hint: Consider Gp(S) in a discrete space; see §11, Example (3).] 
(v) In EB”, if (a, b) 4 @, then 
bd(a, b] = bd[a, 6) = bd(a, b) = bdja, 6] = [a, b] — (a, 0). 
(vi) In E”, (R”)° = 0; hence bd R” = E” (R” as in Problem 6). 


19. Verify Example (8) for intervals in E”. 


§13. Bounded Sets. Diameters 


I. Geometrically, the diameter of a closed globe in E” could be defined as 
the maximum distance between two of its points. In an open globe in E”, there 
is no “maximum” distance (why?), but we still may consider the supremum of 
all distances inside the globe. Moreover, this makes sense in any set A C (5, p). 
Thus we accept it as a general definition, for any such set. 
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Definition 1. 
The diameter of a set A # @ in a metric space (S, ~), denoted dA, is the 
supremum (in E*) of all distances p(x, y), with 2, y € A;' in symbols, 
dA= sup p(z, y). 
z,yEA 
If A = 9, we put dA = 0. If dA < +o, A is said to be bounded (in 
(S, p)). 


Equivalently, we could define a bounded set as in the statement of the fol- 
lowing theorem. 


Theorem 1. A set A C(S, p) is bounded iff A is contained in some globe. If 
so, the center p of this globe can be chosen at will. 


Proof. If A = 9, all is trivial. 

Thus let A 4 @; let g € A, and choose 
any p € S. Now if A is bounded, then 
dA < +00, so we can choose a real ¢ > 
p(p, q)+dA as a suitable radius for a globe 
G,(e) D A (see Figure 11 for motivation). 
Now if x € A, then by the definition of dA, 
p(q, x) < dA; so by the triangle law, 


p(p, £) < p(p, g) + pq, 2) 
< p(p, q) + dA <e; ie. 


ie., 2 € Gy(e). Thus (Vaz € A) x €G,(e), 
as required. 

Conversely, if A C G,(e), then any z, y € A are also in G,,(€); so p(x, p) < € 
and p(p, y) < €, whence 


p(x, y) < p(x, p) + p(p, y) <e +e =2e. 
Thus 2¢ is an upper bound of all p(x, y) with x, y € A. Therefore, 
dA = sup (a, y) < 2e < +00; 


i.e., A is bounded, and all is proved. 


As a special case we obtain the following. 


Theorem 2. A set AC E” is bounded iff there is a real K > 0 such that 
(VzEA) |z|<K 
(similarly in C" *and other normed spaces). 


| Recall that the supremum always exists in E* (finite or not); see Chapter 2, §13. 
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Proof. By Theorem 1 (choosing 0 for p), A is bounded iff A is contained in 
some globe Go(e) about 0. That is, 


(VE A) ZEG(e) or o(Z, 0) = |z| <e. 


Thus ¢€ is the required K. (*The proof for normed spaces is the same.) O 
Note 1. In £', this means that 
(VaEA) -K<a<K; 


i.e., A is bounded by —K and K. This agrees with our former definition, given 
in Chapter 2, §§8—9. 
Caution: Upper and lower bounds are not defined in (S, p), in general. 


Examples. 
(1) @ is bounded, with dQ = 0, by definition. 


(2) Let A = a, b] in E”, with d = p(a, 6) its diagonal. By Corollary 1 in 87, 
d is the largest distance in A. In nonclosed intervals, we still have 


d= sup p(x, y) =dA < +00 (see Problem 10(ii)). 
z,yecA 


Thus all intervals in E” are bounded. 


(3) Each globe G,(e) in (S, p) is bounded, with dG,(e) < 2¢ < +00, as was 
shown in the proof of Theorem 1. See, however, Problems 5 and 6 below. 


(4) All of E” is not bounded, under the standard metric, for if E” had a finite 
diameter d, no distance in E” would exceed d; but p(—dé,, dé,) = 2d, a 
contradiction! 


(5) On the other hand, under the discrete metric (§11, Example (3)), any set 
(even the entire space) is contained in G,(3) and hence bounded. The 
same applies to the metric p’ defined for E* in Problem 5 of §11, since 
distances under that metric never exceed 2, and so E* C G,(3) for any 
choice of p. 


Note 2. This shows that boundedness depends on the metric p. A set may 
be bounded under one metric and not bounded under another. A metric p is 
said to be bounded iff all sets are bounded under p (as in Example (5)). 

Problem 9 of §11 shows that any metric p can be transformed into a bounded 
one, even preserving all sufficiently small globes; in part (i) of the problem, even 
the radii remain the same if they are < 1. 


Note 3. An idea similar to that of diameter is often used to define distances 
between sets. If A~@ and B 4 Qin (S, p), we define p(A, B) to be the infimum 
of all distances p(x, y), with x € A and y € B. In particular, if B = {p} (a 
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singleton), we write p(A, p) for p(A, B). Thus 


p(A, p) = inf p(z, p). 


II. The definition of boundedness extends, in a natural manner, to sequences 
and functions. We briefly write {z,,} C (S, p) for a sequence of points in (5, p), 
and f: A — (S, p) for a mapping of an arbitrary set A into the space S. Instead 
of “infinite sequence with general term 7,” we say “the sequence 2.” 


Definition 2. 
A sequence {2m} C (S, p) is said to be bounded iff its range is bounded 
in (9, p), ie., iff all its terms x,, are contained in some globe in (S, p). 
In E£”, this means (by Theorem 2) that 
(Vi) lt | Se 


for some fixed K € E!.2 


Definition 3. 


A function f: A — (5S, p) is said to be bounded on a set B C A iff the 
image set f[B] is bounded in (S, p); i-e. iff all function values f(x), with 
x € B, are in some globe in (5S, p). 

In £”, this means that 


(Vee B) |f(a)|/<K 


for some fixed K € E!.? 
If B = A, we simply say that f is bounded. 


Note 4. If S = E' or S = E*, we may also speak of upper and lower 
bounds. It is customary to call sup f[B] also the supremum of f on B and 
denote it by symbols like 


sup f(x) or sup{f(x) | a © B}. 
xeEB 


In the case of sequences, we often write sup,,, 2m OF SUP XZ», instead; similarly 
for infima, maxima, and minima. 


Examples. 


(a) The sequence 


Im=— in FE! 
m 


is bounded since all terms x, are in the interval (0, 2) = G,(1). We have 
inf ¢,, = 0 and sup 2, = maxz,,,= 1. 


2 *Similarly in C” and other normed spaces. 
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(b) 


=> 
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The sequence 
Im=m in E! 
is bounded below (by 1) but not above. We have infz,, = minz, = 1 
and sup 2m = +00 (in E*). 
Define f: E! > E' by 
Cs eae 


This map is bounded on each finite interval B = (a, b) since f|B] = 
(2a, 2b) is itself an interval and hence bounded. However, f is not 
bounded on all of E+ since f[E1] = E' is not a bounded set. 


Under a bounded metric p, all functions f: A — (S, p) are bounded. 
The so-called identity map on S, f: S — (S, p), is defined by 


f(x) =«. 
Clearly, f carries each set B C S onto itself; ie., f[B] = B. Thus f is 
bounded on B iff B is itself a bounded set in (5, p). 
Define f: E! > E' by 
Fe) = sin. 
Then f[E"] = [-1, 1] is a bounded set in the range space E'. Thus f is 
bounded on E! (briefly, bounded). 


Problems on Boundedness and Diameters 


1. Show that if a set A in a metric space is bounded, so is each subset 
BCA. 


2. Prove that if the sets Ai, Ao, ..., An in (S, p) are bounded, so is 
LJ Ar. 
k=1 


Disprove this for infinite unions by a counterexample. 
[Hint: By Theorem 1, each Ax is in some Gp(ex), with one and the same center 
p. If the number of the globes is finite, we can put max(é1,..., €n) = €, so Gp(e) 
contains all A;,. Verify this in detail.] 

3. From Problems 1 and 2 show that a set A in (S, p) is bounded iff it is 
contained in a finite union of globes, 


U G(pri Ex)- 


k=1 
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4. A set A in (5S, p) is said to be totally bounded iff for every « > 0 (no 


5. 


6. 


matter how small), A is contained in a finite union of globes of radius 
€. By Problem 3, any such set is bounded. Disprove the converse by a 
counterexample. 


[Hint: Take an infinite set in a discrete space.] 
Show that distances between points of a globe G,(e) never exceed 2e. 
(Use the triangle inequality!) Hence infer that dG,(e) < 2e. Give an 
example where dG',(e) < 2¢. Thus the diameter of a globe may be less 
than twice its radius. 
[Hint: Take a globe Gp(5) in a discrete space.| 
Show that in E” (*as well as in C” and any other normed linear space 
# {0}), the diameter of a globe G,(€) always equals 2e (twice its radius). 
[Hint: By Problem 5, 2¢ is an upper bound of all p(%, 9) with Z, 9 € Gp(e). 
To show that there is no smaller upper bound, prove that any number 
2e—2r (r>0) 

is exceeded by some p(Z, ¥); e.g., take Z and y on some line through 9, 

z=p+t ti, 


choosing suitable values for t to get p(%, y) = |Z — y| > 2e — 2r.] 


7. Prove that in E”, a set A is bounded iff it is contained in an interval. 


8. Prove that 


10. 


p(A, B) < p(A, p) + p(p, B). 
Disprove 


p(A, B) < p(A, p) + p(p, B) 


by an example. 


. Find supz,, infx,, maxz,, and minz, (if any) for sequences with 


general term 
(a) n; 
(b= DP 22" ©); 
2 
1 a es 
() 1-5: 
n(n — 1) 
d) ——~. 
(d) (n + 2)? 
Which are bounded in E!? 
Prove the following about lines and line segments. 


(i) Show that any line segment in E” is a bounded set, but the entire 
line is not. 


(ii) Prove that the diameter of L(@, b) and of (a, 6) equals p(a, 5). 
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11. Let f: E! > E' be given by 


a= - ioe 0,and j(0)=0. 


Show that f is bounded on an interval |a, b] iff 0 ¢ [a, b]. Is f bounded 
on (0, 1)? 
12. Prove the following: 
(a) If AC BC (S, p), then dA < dB. 
(b) dA = 0 iff A contains at most one point. 
(c) If ANB #9, then 
d(AUB) <dA+dB. 


Show by an example that this may fail if AN B = 0. 


§14. Cluster Points. Convergent Sequences 


1 1 
A= {1, secs bs 
2 m 


we may as well let A denote the sequence tm = 1/m in E+.’ Plotting it on 
the axis, we observe a remarkable fact: The points x,, “cluster” close to 0, 
approaching 0 as m increases—see Figure 12. 


Consider the set 


—eE E 


LU 
0 Al 
76 


| 
a 1 
2 

FIGURE 12 


| | 
af 
4 3 


oe 


To make this more precise, take any globe about 0 in E1, Go(e) = (—e, €). 
No matter how small, it contains infinitely many (even all but finitely many) 
points x,,, namely, all from some x; onward, so that 


(Vm>k) tm € Gole). 
Indeed, take k > 1/e, so 1/k <¢. Then 


1 
(Vm > k) a Se 


1 
m 
i.€., Lm € (—€, €) = Go(e). 

This suggests the following generalizations. 


1 “Sequence” means “infinite sequence”; m, n, k denote integers > 0. 
7 ? ? 
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Definition 1. 


A set, or sequence, A C (5, p) is said to cluster at a point p € S (not 
necessarily p € A), and p is called its cluster point or accumulation point, 
iff every globe G, about p contains infinitely many points (respectively, 
terms) of A. (Thus only infinite sets can cluster.) 


Note 1. In sequences (unlike sets) an infinitely repeating term counts as 
infinitely many terms. For example, the sequence 0, 1, 0,1, ... clusters at 0 
and 1 (why?); but its range, {0, 1}, has no cluster points (being finite). This 
distinction is, however, irrelevant if all terms x,, are distinct, i.e., different from 
each other. Then we may treat sequences and sets alike. 


Definition 2. 


A sequence {%m} C (S, p) is said to converge or tend to a point p in S, 
and p is called its limit, iff every globe G,(¢) about p (no matter how 
small) contains all but finitely many terms 2m.” In symbols, 


(Ve> 0) GR) (VreS kh). tee Gyles), 16s Pl ling DP) <e- (1) 


If such a p exists, we call {z,,} a convergent sequence (in (5S, p)); 
otherwise, a divergent one. The notation is 


tn > p, or img, =p, or lm. x, — p 
m—- oo 


In E”,? o(Zm, P) = |Zm — Hl; thus formula (1) turns into 


Em > pin E” iff Ve>0) (Gk) (Vm>k) |Em—pd| <e. (2) 


Since “all but finitely many” (as in Definition 2) implies “infinitely many” (as 
in Definition 1), any limit is also a cluster point. Moreover, we obtain the 
following result. 


Corollary 1. If tj, — p, then p is the unique cluster point of {vm}. (Thus a 
sequence with two or more cluster points, or none at all, diverges.) 


For if p # q, the Hausdorff property (Theorem 1 of §12) yields an € such 
that 


Gy(€) NGg(e) = 9. 


AS im — p, Gp(e) leaves out at most finitely many 2,,, and only these can 
possibly be in Gg(e). (Why?) Thus qg fails to satisfy Definition 1 and hence is 
no cluster point. Hence lim z,, (if it exists) is unique. 


2 That is, Gp(e) leaves out at most finitely many terms xm, say, £1, 2, ..., U,_, whereas 
in Definition 1, Gp(e) may leave out even infinitely many points of A. 
3*Similarly for sequences in C” and in other normed spaces (§10). 
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Corollary 2. 

(i) We have rm — p in (S, p) iff p(2m, p) 20 in E’. 
Hence 

(ii) 2m > pin E” iff |Zm —p| > 0 and 

(iii) Z, 30 in E” iff |Zm| 7 0. 


Proof. By (2), we have p(am, p) > 0 in E? if 


(Ve > 0) (Ak) (Vm >k) |p(am, p) — 0] = p(tm, Pp) < €. 


By (1), however, this means that x,, — p, proving our first assertion. The rest 
easily follows from it, since p(Zm, Pp) =|%Zm — pl in BE”. O 


Corollary 3. If x, tends to p, then so does each subsequence &m,,. 


For 2, — p means that each G, leaves out at most finitely many z,,. This 
certainly still holds if we drop some terms, passing to {%m, }. 


Note 2. A similar argument shows that the convergence or divergence of 
{fm}, and its limit or cluster points, are not affected by dropping or adding 
a finite number of terms; similarly for cluster points of sets. For example, if 
{@m} tends to p, so does {%m+41} (the same sequence without 2). 

We leave the following two corollaries as exercises. 


Corollary 4. If {xm} splits into two subsequences, each tending to the same 
limit p, then also tm — p. 


Corollary 5. Jf {x} converges in (S, p), it is bounded there. (See Problem 4.) 


Of course, the convergence or divergence of {x,,} and its clustering depend 
on the metric p and the space S. Our theory applies to any (S, p). In particu- 
lar, it applies to E*, with the metric p’ of Problem 5 in §11. Recall that under 
that metric, globes about +oo have the form (a, +00] and [—ov, a), respec- 
tively. Thus limits and cluster points in (£*, p’) coincide with those defined 
in Chapter 2, §13, (formulas (1)—(3) and Definition 2 there).4 Our theory then 
applies to infinite limits as well, and generalizes Chapter 2, §13. 


Examples. 
(a) Let 
tn =p tor allan 
(such sequences are called constant). As p € Gp, any Gp contains all 


Lm. Thus 2, — p, by Definition 2. We see that each constant sequence 
converges to the common value of its terms. 


4 The second part of Chapter 2, §13, should be reviewed at this stage. 
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(b) 


In our introductory example, we showed that 


1 
lim —=0 in £E’ 
moo m 
and that 0 is the (unique) cluster point of the set A = {1, 5, ...}. Here 
O¢ A. 
The sequence 
0,1,0,1,... 


has two cluster points, 0 and 1, so it diverges by Corollary 1. (It “os- 
cillates” from 0 to 1.) This shows that a bounded sequence may diverge. 
The converse to Corollary 5 fails. 


The sequence 
C= 


(or the set N of all naturals) has no cluster points in E', for a globe of 
radius < 5 (with any center p € E+) contains at most one 2, and hence 
no p satisfies Definition 1 or 2. 


* 


However, {2} does cluster in (E*, p’), and even has a limit there, 


namely +oo. (Prove it!) 


The set R of all rationals in E! clusters at each p € E'. Indeed, any 
globe 

Gp(€) = (p —€, p+) 
contains infinitely many rationals (see Chapter 2, §10, Theorem 3), and 
this means that each p € EF! is a cluster point of R. 


The sequence 

1 1 
~,3,=,... 
9 2 2 3 2 
has only one cluster point, 0, in E'; yet it diverges, being unbounded (see 
Corollary 5). In (E%*, p’), it has two cluster points, 0 and +oo. (Verify!) 


t 
di, 1. 2s (with LIk = a and LAk-1 = k) 


The lim and lim of any sequence in E* are cluster points (cf. Chapter 2, 
813, Theorem 2 and Problem 4). Thus in E*, all sequences cluster. 


Let 
A=|a,b], a<b. 


Then A clusters exactly at all its points, for if p € A, then any globe 
G,(€) a p==, pre) 


overlaps with A (even with (a, 6)) and so contains infinitely many points 
of A, as required. Even the endpoints a and b are cluster points of A (and 
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of (a, 6), (a, 6], and [a, b)). On the other hand, no point outside A is a 
cluster point. (Why?) 


(i) In a discrete space (§11, Example (3)), no set can cluster, since small 
globes, such as G,(4), are singletons. (Explain!) 


Example (h) shows that a set A may equal the set of its cluster points (call 
it A’); ie., 
A=A’. 
Such sets are said to be perfect. Sometimes we have A C A’, A’ C A, A’ =S 
(as in Example (e)), or A’ = @. We conclude with the following result. 
Corollary 6. A set A C (S, p) clusters at p iff each globe G', (about p) contains 
at least one point of A other than p.° 


Indeed, assume the latter. Then, in particular, each globe 


contains some point of A other than p; call it x,. We can make the z,, distinct 
by choosing each time 7,41 closer to p than %,y is. It easily follows that each 
G,(€) contains infinitely many points of A (the details are left to the reader), 
as required. The converse is obvious. 


Problems on Cluster Points and Convergence 


1. Is the Archimedean property (see Chapter 2, §10) involved in the proof 
that 


1 
lim —=0? 
m—oo m 


2. Prove Note 2 and Corollaries 4 and 6. 
3. Verify Example (c) in detail.® 
4. Prove Corollary 5. 


[Hint: Fix some Gp(e). Use Definition 2. If Gp(e) leaves out x1, v2, ..., wp, take a 
larger radius r greater than 


o(tm,p), m=1,2,...,k. 
Then the enlarged globe Gp(r) contains all zm. Use Theorem 1 in §13.] 
5. Show that x2,, = m tends to +oo in E*. Does it contradict Corollary 5? 
6. Show that E? is a perfect set in E!: E' = (E')’. Is E1 a perfect set in 
E*? Why? 


° This corollary does not apply to cluster points of sequences. 
8 In particular, show that there are no other cluster points. 
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=>T. 


11. 


12. 


13. 


14. 
15. 


16. 


Review Problems 2 and 4 of Chapter 2, §13. (Do them if not done 
before.) 


. Verify Examples (f) and (h). 
. Explain Example (i) in detail. 
10. 


In the following cases find the set A’ of all cluster points of A in E1. Is 
A’ C A? Is AC A’? Is A perfect? Give a precise proof. 


(a) A consists of all points of the form 
1 1 
—and1l+-, n=1,2,...; 
n n 


i.e., A is the sequence 


11 1 1 
i ee ee | = tv be 
{ 2 2 n a 


Does it converge? 
(b) A is the set of all rationals in (0, 1). Answer: A’ = [0, 1]. Why? 


(c) A is the union of the intervals 


2n 2n+1 


=6. 1, Be .cci 
mel Ineo)? 


(d) A consists of all points of the form 
2 and2 "+9 "", ni, kEN, 


Can a sequence {x} C E' cluster at each p € E'? 
[Hint: See Example (e).] 
Prove that if 

p =supA or p= inf Ain E! 


(0A AC E'), and if p Z A, then p is a cluster point of A. 
[Hint: Take Gp(e) = (p—e¢, p+e). Use Theorem 2 of Chapter 2, §§8-9.] 


Prove that a set A C (S, p) clusters at p iff every neighborhood of p 
(see §12, Definition 1) contains infinitely many points of A; similarly for 


sequences. How about convergence? State it in terms of cubic neigh- 
borhoods in E”. 


Discuss Example (h) for nondegenerate intervals in E”. Give a proof. 


Prove that a set A 4 @ clusters at p (p ¢ A) iff p(p, A) = 0. (See 813, 
Note 3.) 


Show that in E” (*and in any other normed space # {0}), the cluster 
points of any globe G;(e) form exactly the closed globe G5(e), and that 
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G5(e) is perfect. Is this true in other spaces? (Consider a discrete 
space!) 

[Hint: Given ¢ € Gp(e) in E”, show that any Gq(d) overlaps with the line pg. Show 
also that no point outside Gg(e) is a cluster point of Gp(e).] 


17. (Cantor’s set.) Remove from [0, 1] the open middle third 


(5:5): 


From the remaining closed intervals 


[o. 3] one [5,3 


remove their open middles, 


(5 3) m4 (5:3): 


Do the same with the remaining four closed intervals, and so on, ad 
infinitum. The set P which remains after all these (infinitely many) 
removals is called Cantor’s set. 

Show that P is perfect. 
[Hint: If p ¢ P, then either p is in one of the removed open intervals, or p ¢ [0, 1]. 
In both cases, p is no cluster point of P. (Why?) Thus no p outside P is a cluster 
point. 

On the other hand, if p € P, show that any Gp(e) contains infinitely many 
endpoints of removed open intervals, all in P; thus p € P’. Deduce that P = P’.] 


§15. Operations on Convergent Sequences! 


Sequences in E! and C can be added and multiplied termwise; for example, 
adding {z,,} and {ym}, one obtains the sequence with general term tm, + Ym. 
This leads to important theorems, valid also for E” (*and other normed spaces). 
Theorem 1 below states, roughly, that the limit of the sum {am + Ym} equals 
the sum of lima, and limy,, (if these exist), and similarly for products and 
quotients (when they are defined).? 


Theorem 1. Let tm > q, Ym 3 T, and am > a in E* or C (the complex 
field). Then 


G) Gn Lin = GET 


1 This section (and the rest of this chapter) may be deferred until Chapter 4, §2. Then 
Theorems 1 and 2 may be combined with the more general theorems of Chapter 4, §3. (It is 
rather a matter of taste which to do first.) 

? Theorem 1 is known as “continuity of addition, multiplication, and division” (for reasons 
to be clarified later). Note the restriction a # 0 in (iii). 
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(ii) @m2m > aq; 


(iii) + = ifa #0 and for allm > 1, am, #0. 


This also holds if the Lm, Ym, q, andr are vectors in E™ (*or in another normed 
space), while the am anda are scalars for that space. 


Proof. (i) By formula (2) of §14, we must show that 


(Ve>O0) (4k) Vm> kh) etbom —tr)| <2. 


Thus we fix an arbitrary ¢ > 0 and look for a suitable k. Since x,, — q and 
Ym — 7, there are k’ and k” such that 


(Vm>k’') |tm—4q| < 


and 


(Vm>k") lym —r| < 


(as € is arbitrary, we may as well replace it by 46). Then both inequalities hold 
form > k, k = max(k’, k’’). Adding them, we obtain 


(Vm >k) |tm—gq|tl¥m—r| <e. 
Hence by the triangle law, 


te =O (ie = 1)| < S; Ley lta tom — (Ger) <2 for m> &k, 


as required. 


This proof of (i) applies to sequences of vectors as well, without any change. 
The proof of (ii) and (iii) is sketched in Problems 1-4 below. 


Note 1. By induction, parts (i) and (ii) hold for sums and products of any 
finite (but fixed) number of suitable convergent sequences. 


Note 2. The theorem does not apply to infinite limits q, r, a. 


Note 3. The assumption a 4 0 in Theorem 1 (iii) is important. It ensures 
not only that q/a is defined but also that at most finitely many am can vanish 
(see Problem 3). Since we may safely drop a finite number of terms (see Note 2 
in $14), we can achieve that no a, is 0, so that %/dm is defined. It is with 
this understanding that part (iii) of the theorem has been formulated. The 
next two theorems are actually special cases of more general propositions to be 
proved in Chapter 4, §§3 and 5. Therefore, we only state them here, leaving 
the proofs as exercises, with some hints provided. 


Theorem 2 (componentwise convergence). We have i, — p in E™ (*C”) iff 
each of the n components of ZX tends to the corresponding component of p, 
i.€., iff Lmk > Pr, k =1, 2,..., n, in E*(C). (See Problem 8 for hints.) 
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Theorem 3. Every monotone sequence {x,} C E* has a finite or infinite 
limit, which equals sup,, 2n if {%n}t andinfn tn if {an}. If {rn} is monotone 
and bounded in E1, its limit is finite (by Corollary 1 of Chapter 2, §13). 


The proof was requested in Problem 9 of Chapter 2, 813. See also Chapter 4, 
85, Theorem 1. An important application is the following. 


Example (the number e). 
1\n 
Let x, = (1 + =) in E!. By the binomial theorem, 
n 


n(n—1)  n(n—1)(n—-2) 


By oor 2! n? 3! n3 


a he 


If n is replaced by n+ 1, all terms in this expansion increase, as does 
their number. Thus x, < %n41, i.e., {Gn }t. Moreover, for n > 1, 


i O02 = ated 29 Acad 
Ln —: eee — — eee a. 
2 ra 2 grt 
1\n-1 
1 = 
=245(14 ie )=245 (5) <24+1=3 
"2 pap 2 i — 
2 


Thus 2 < ¢, < 3 for n > 1. Hence 2 < sup, gn < 3; and by Theorem 3, 


sup, , = limz,. This limit, denoted by e, plays an important role in 
analysis. It can be shown that it is irrational, and (to within 107°) 
e = 2.71828182845904523536.... In any case, 


2<e= lim (1+-)"<3 (1) 
nm 


N— Co 


The following corollaries are left as exercises for the reader. 


Corollary 1. Suppose limz,, =p and limym = q exist in E*. 
(a) Ifp>q, thentm > Ym for all but finitely many m. 
(b) If&@m < Ym for infinitely many m, then p < q; i.e., lima < lim ym. 


This is known as passage to the limit in inequalities. Caution: The strict 
inequalities 7, < Ym do not imply p < q but only p < q. For example, let 


1 
Cn = — and 44 = 0. 
m 
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Then 
(Fi) aig. > tas 
yet ling, = lim gy, = 0; 


Corollary 2. Let x, — p in E*, and let c € E* (finite or not). Then the 
following are true: 


(a) Ifp > c (respectively, p < c), we have Lm > C (Lm < c) for all but finitely 
many m. 


(b) [fam < c (respectively, Lm > c) for infinitely many m, then p < c (p>). 


One can prove this from Corollary 1, with y,, = c (or tm =) for all m. 


Corollary 3 (rule of intermediate sequence). If 2» — p and Ym — p in E* 
and tf 2m <2Zm <Ym for all but finitely many m, then also zm — p. 


Theorem 4 (continuity of the distance function). Jf 
Lm > p and ym — q in a metric space (S, p), 
then 
p(tm; Ym) > p(p, q) in BE. 
Hint: Show that 


|P(Zm; Ym) — P(D, @)| < elem, P) + O(G, Ym) > 9 
by Theorem 1. 


Problems on Limits of Sequences 
See also Chapter 2, §13. 
1. Prove that if x, — 0 and if {a,,} is bounded in E! or C, then 
Gata. 0. 


This is true also if the x,, are vectors and the a,, are scalars (or vice 
versa). 
[Hint: If {am} is bounded, there is a K € E! such that 


(Vm) |am| < K. 


As 2m — 0, 


(Ve>0) (Sk) (Vm >k) lam| < = (why?), 


80 |am&@m| < €.] 


2. Prove Theorem 1 (ii). 
[Hint: By Corollary 2(ii)(iii) in §14, we must show that ama@m — aw > 0. Now 


Am&m — aq = Am(Lm — gq) + (am — a)q, 
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where tm — q > 0 and @m — a— 0 by Corollary 2 of §14. Hence by Problem 1, 
am(L&m — q) + 0 and (am — a)q > 0 


(treat q as a constant sequence and use Corollary 5 in §14). Now apply Theorem 1(i).] 


. Prove that if am, 4 a and a4 0 in E' or C, then 


(de >0) (Ak) (Vm>k) Jam| >. 


(We briefly say that the a,, are bounded away from 0, for m > k.) Hence 
prove the boundedness of {1} for ai. > kh; 


[Hint: For the first part, proceed as in the proof of Corollary 1 in §14, with zm = am, 
p=a,and q=0. 


For the second part, the inequalities 
1 1 
(Vm > k) —| 22 
am € 


lead to the desired result.] 


. Prove that if a,, > a #0 in FE! or C, then 


1 | 


ie = 
Use this and Theorem 1(ii) to prove Theorem 1(iii), noting that 


Lm _ 1 


=m 


am am 


[Hint: Use Note 3 and Problem 3 to find that 


1 1 1 
(Vm > k) J— - -|=— lam — a 
adm a |a| 


1 
Jaen” 


1 1 
where {—} is bounded and il |am — a| + 0. (Why?) 
am a 


1 1 
—- | — 0. Proceed.] 
adm a 


Hence, by Problem 1, 


. Prove Corollaries 1 and 2 in two ways: 


(i) Use Definition 2 of Chapter 2, §13 for Corollary 1(a), treating in- 
finite limits separately; then prove (b) by assuming the opposite 
and exhibiting a contradiction to (a). 


(ii) Prove (b) first by using Corollary 2 and Theorem 3 of Chapter 2, 
813; then deduce (a) by contradiction. 


6. Prove Corollary 3 in two ways (cf. Problem 5). 
7. Prove Theorem 4 as suggested, and also without using Theorem 1(i). 


8. Prove Theorem 2. 


[Hint: If Zm > p, then 


(Ve >0) Ga) (Vm >q) €>|Sm—p| 2 |eme — Pel. (Why?) 
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Thus by definition t,,, > pr, k= 1, 2,..., n. 
Conversely, if so, use Theorem 1(i)(ii) to obtain 


mr n 
5 Lmkek > 5 Pkek, 
k=1 k=1 


with &; as in Theorem 2 of §§1-3]. 
8’. In Problem 8, prove the converse part from definitions. (Fix € > 0, etc.) 


9. Find the following limits in £1, in two ways: (i) using Theorem 1, 
justifying each step; (ii) using definitions only. 


m+1 3m +2 
l ——; b) li 
a a Ye aa 
I n(n — 1) 
l 
e) ND rar ae ee 1a 


[Solution of (a) by the first method: Treat 


1 1 
m+ Siete = 
m 


m 


as the sum of 2m = 1 (constant) and 
1 ‘ 
Ym = — — 0 (proved in §14). 
m 


Thus by Theorem 1(i), 
m+1 


Second method: Fix ¢ > 0 and find k such that 


1 
(Vm > k) > 
m 


-il<e. 


1 1 
Solving for m, show that this holds ifm > —. Thus take an integer k > —, so 
E € 


m+1 
m 


(Vm >k) | -i)<e. 


Caution: One cannot apply Theorem 1(iii) directly, treating (m+ 1)/m as the 
quotient of 7», = m+1 and am =m, because @m and am diverge in E}. (Theorem 1 
does not apply to infinite limits.) As a remedy, we first divide the numerator and 
denominator by a suitable power of m (or 7n).] 


10. Prove that 


1 
|2m| — +oo in E* iff — +0 (tm #0). 


Lm 
11. Prove that if 


Lm + +00 and ym > gq # —co in E*, 
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then 
Lm + Ym > +00. 


This is written symbolically as 
“too + q = +00 if g # —co.” 
Do also 
“99 + q = —o0 if ¢q # +00.” 
Prove similarly that 
“(+00) -g = +00 if g > 0” 
and 
“(+00) -q = —o0 if q < 0.” 
(Hint: Treat the cases q € E', q = +00, and q = —oo separately. Use definitions.] 
12. Find the limit (or lim and lim) of the following sequences in E*: 
(4) ty = 2-425 2a = 2" nk 
fin = bn — n°; 


) 
(c) %_ = 2n* — n? — 3n? — 1; 
) 


(d) tp = (—1)"n!; 
(é) &, = a 


[Hint for (b): an = n(5 —n?); use Problem 11.] 
13. Use Corollary 4 in §14, to find the following: 
ee 

l 

OY oes tage 
1—n+(-1)” 
m — 

n—0o 2n+1 


2 


(a) lim 


(c) lim 


[Hint: Compute )77_, k™ using Problem 10 of Chapter 2, §§5-6.] 


il 2 
What is wrong with the following “solution” of (a): — — 0, = - 0, 
etc.; hence the limit is 0? a n 
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15. 


16. 


17. 


18. 


For each integer m > 0, let 
Smn = 1" +27 4---+n™, 


Prove by induction on m that 


[Hint: First prove that 


m—-1 
= mt+1 4 _ m+1 d 
(m+1)Smn = (n+ 1) 1 2d ( : \ Sms 
by adding up the binomial expansions of (k +1)™+!,k=1,..., n.] 


Prove that 


lim g@" = +e lig >1; lim g*=O0i lg) <1; lim 1*=1. 
n—- oo noo 


n—0o 
[Hint: If g >1, put g=1+d,d>0. By the binomial expansion, 

q’ =(1+d)” =1+4+nd+---+d" >nd—- +00. (Why?) 
If |q| < 1, then |< | > 1; so lim| =|" = +00; use Problem 10.] 
Prove that 


lim — =Oif|q|>1, and lim — = +00 if0<q<1. 
nm n—oo gq” 


Nn—- co qd 


[Hint: If |g| > 1, use the binomial as in Problem 16 to obtain 


2 


1 n 
Rs n= 1)a", n> 2, so — < ——= > 


0. 
Use Corollary 3 with 


nm 
tn = 0, eal = Tn nee a 


to get |zn| + 0; hence also z, — 0 by Corollary 2(iii) of §14. In case 0 < q < 1, 
10.] 


Let r, a € E'. Prove that 


lim n'a” = Ot |a| > 1. 
nN Co 


[Hint: If r > 1 and a> 1, use Problem 17 with g = a1/T to get na—”/" + 0. As 
O<n"a "= (na~"/7)" <na—"/" + 0, 


obtain n™a~” — 0. 
Ifr <1, then n"a~” < na~” > 0. What if a < -17] 


127 


use 


128 Chapter 3. Vector Spaces. Metric Spaces 


19. (Geometric series.) Prove that if |g] < 1, then 


a 
lim (ataq+-:-+aq™*) = ; 
n—0o l-q 
[Hint: 
1—q” 
a(L+qt-.+q"1) =a, 
diag 


where qg” — 0, by Problem 16.] 
20. Let 0 < c< +o. Prove that 


lim V/c=1. 


Nn CoO 
[Hint: Ife >1, put Ye=1+dn, dyn > 0. Expand c = (1+d,)” to show that 
tte 0, 
n 


so dy, + 0 by Corollary 3.] 


21. Investigate the following sequences for monotonicity, lim, lim, and lim. 


(In each case, find suitable formula, or formulas, for the general term.) 

(a) 2s Be My V7, 2G e es.03 

(O) D0. 92-9 as 
(c) 2, —2, —6, —10, —14,...; 
(dy dl i le hI tet 

3:2 4-6 5-10 6-14 

) “qi geo) ag es 

22. Do Problem 21 for the following sequences. 
1 —8 27 —-64 125 
©) yaa i556 67 


2 

2 5 8 13 
Pg? 9? 9? 9 

2 24 4 6 6 
5a orm ee 
Cd). 1, 2y.5, 45. 1, By by BM 8. Bo eeny Aly Oe Des weds 
(ec) 0.9, 0.99, 0.999, 
re ee 
(g) —oo, 1, ioe 

2 n 


23. Do Problem 20 as follows: If c > 1, { Yc}l. (Why?) By Theorem 3, 
p= lim Vc exists and 
n> oo 


(Wn) Lapa Ve, ten lapse 
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By Problem 16, p cannot be > 1, so p= 1. 
In case 0 < c < 1, consider ¥/1/c and use Theorem 1 (iii). 


24. Prove the existence of lim, and find it when 2,, is defined inductively 
by 


(i) LY V2, In+1 =v 2055 
(ii) 23 =c> 0, Sng1 =VC* + 2n; 


Cx Cc 
Gili) oy =e > 0, t_44 = ——; hence deduce that lim — = 0. 


[Hint: Show that the sequences are monotone and bounded in E! (Theorem 3). 


For example, in (ii) induction yields 
In <@n41<c+1. (Verify!) 
Thus ling, = limzn+1 = p exists. To find p, square the equation 
tnt1 = Ve? +2n (given) 


and use Theorem 1 to get 
p? =c?+p. (Why?) 


Solving for p (noting that p > 0), obtain 
p=limgryn = s(t + V/4c? +1); 
similarly in cases (i) and (iii).] 
25. Find lima, in E! or E* (if any), given that 
(a) t, =(n+1)?-n1,0<¢<],; 
(b) tr = V/n(v¥n+1— vn); 
1 
(C) fn = ——; 
ne eh 
(d) t, =n(n+ 1)c”, with |c| < 1; 


m 
(e) ty = So aR, with az, > 0; 
k=1 


(f) tn = 


COo| NI 
— 
iw) 
3 
+ 
—_ 
wa 


[Hints: 


(a) 0< an =ni[(1+=)"-1] <ni(1+—-1) =n?—! -5 0. (Why?) 


1 1 1 
b) 2n = ——————, where 1 < 4/1+ —<1+ —-— 1,80 ¢n > §. (Why? 
(b) 1+ /f/14+1/n n n a Wanye) 


(c) Verify that 
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SO Ln — 1 by Corollary 3. (Give a proof.) 
(d) See Problems 17 and 18. 


(e) Let a = max(aj, ..., @m). Prove that a < a, <a Ym. Use Problem 20.] 


The following are some harder but useful problems of theoretical importance. 


The explicit hints should make them not too hard. 
26. Let {z,} C E?. Prove that if x, — p in E', then also 


1 
lim — Ly = 
ee 


(i.e., p is also the limit of the sequence of the arithmetic means of the 


iA) 
[Solution: Fix ¢ > 0. Then 


Ak) (Vn >k) p— = <an<pt—. 


— 
! 


Adding n — k inequalities, get 
€ n E 
(n — k)(p- =) < a Li<(n- k) (p+ =): 
i=k+1 
With k so fixed, we thus have 


k E 


(Vn > k) PE (p—£) <= (eng t- tan) < "(p+ £). 


4 
Here, with k& and é¢ fixed, 


lim n= (p-) =p-<. 


noo n 4 


Hence, as p — se <p- te, there is k’ such that 


(Vn > k’) p-=< nm" (p-<). 


Similarly, 

—k E E 
ae) Vnswy) 222 e S 
)(vn>k") 2 (p+ =) <p+= 


— 


Combining this with (i), we have, for K’ = max(k, k’, k’’), 


E 1 € 
(Vn>K’') p--= <7 (Geta t+ tan) <Pt 5- 


2 
Now with k fixed, 
. 1 
lim —(#1 +%2+--:-+2,) =0. 
noo n 
Hence 


E 
2 


4K") (Vn>K") 


— 


1 E 
< —(a1 +++: +a) < x. 
n 2 


(i) 


(ii) 
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26’ 


27. 


28. 


29. 


30. 


Let K = max(K’, K’’). Then combining with (ii), we have 
1 
(Vn >K) p-ex< 7 tite + en) <P te, 


and the result follows.] 


Show that the result of Problem 26 holds also for infinite limits p = 
too € E*. 


Prove that if z, — p in E* (x, > 0), then 
lia 0/2 o* = =n, =P. 
n—0o 
[Hint: Let first 0 < p< +00. Given € > 0, use density to fix 6 > 1 so close to 1 that 
p-e<i<p<pi<pte. 


AS fn > Pp, 


= Pp 4 

dk) (Vn>k) == <an< pw. 

(4k) ( ) WH 

Continue as in Problem 26, replacing « by 6, and multiplication by addition (also 


subtraction by division, etc., as shown above).? Find a similar solution for the case 
p = +00. Note the result of Problem 20.] 


Disprove by counterexamples the converse implications in Problems 26 
and 27. For example, consider the sequences 


ees es es 


and 


Prove the following. 
(i) If {x,} C E* and Jim (an+1 —zx,) = pin E*, then = =e 


(ii) If {2,} C E! (zp, > 0) and if eu p€ E*, then 7/2, p. 
os 


nm 
Disprove the converse statements by counterexamples. 
[Hint: For (i), let y: = 21 and yn = @n — In-1, n= 2, 3,.... Then yn > p and 


so Problems 26 and 26’ apply. 
For (ii), use Problem 27. See Problem 28 for examples.] 


From Problem 29 deduce that 
(a) lim Vn! = +00; 


3 Another solution (reducing all to Problem 26) will be obtained by applying logarithms. 
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.. wl 
(b) lim =0; 
noo ni 
n” 
(c) lim 4/— =6; 
n—0o n! 
' 1 
(d) lim —Vn!=-; 
n—00 nN € 
(ec) lim Yn=1 
n—- oo 
31. Prove that 
. a+ 2b 
linn 2, = ; 
noo 3 
given 
j= 6, 2) =), and Gaia = 3 (tn + Ln41)- 
[Hint: sale that the differences dyn = tn — %n—1 form a geometric sequence, with 
ratio g = —4, and tn =a+ > ;_, dy. Then use the result of Problem 19.] 


=>32. For any sequence {z,,} C E’, prove that 


ling, < lim — > < lim — Sa; <limz,. 


i=1 4=1 


Hence find a new solution of Problems 26 and 26’. 
[Proof for lim: Fix any k € N. Put 
k 
c= a, and b= sup aj. 
a irk 


Verify that 
(Vn >k) pei t+ eppo +-+-+24n < (n—k)b. 


Add c on both sides and divide by n to get 
Cc —k . 
(Vn > k) 3 Ly < — + —— b. (i*) 


n 


—k 
Now fix any « > 0, and first let |b] < +00. As © + 0and “= *) b, there is 
np > k such that m " 


Thus by (i*), 


This clearly holds also if b = sup x; = +00. Hence also 
i>k 


sup — = a 
n>nz a= 


§15. Operations on Convergent Sequences 133 
As k and € were arbitrary, we may let first k — +00, then ¢ > 0, to obtain 


—1—~ __ 
lim — > a, < lim supz; =limaz,. (Explain!)] 
n ant k+00 j>k 


=>33. Given {z,} C E1, 2, > 0, prove that 


lim #,, < lim 7/%1%9-++%, and lim %/7,%9---x, < limZ,. 


Hence obtain a new solution for Problem 27. 
[Hint: Proceed as suggested in Problem 32, replacing addition by multiplication.| 


34. Given 2p, Yn € E (Yn > 0), with 
In > pe E* and bn = Sy; + +00, 
i=1 


prove that 


n 
lim Dian CiYi _ 
= = 
moo DT Yi 


Note that Problem 26 is a special case of Problem 34 (take all y,, = 1). 
[Hint for a finite p: Proceed as in Problem 26. However, before adding the n — k 
inequalities, multiply by y; and obtain 


nm nm n 
E E 
(p- =) > Yi < S> ziyi < (p+ =) Yi- 
nm 
Put by = Sou and show that 
4=1 
it i ee 
he S> wiyi = 1— 7D) wivis 
” j=k4+1 nm j=1 


where by, — +00 (by assumption), so 

1 k 

- wy (for a fixed k) 
Proceed. Find a proof for p = +00.] 


35. Do Problem 34 by considering lim and lim as in Problem 32. 


[Hint: Replace = by mane where by, = yi > +00.] 
a bn i=1 


36. Prove that if u,, uv, € E+, with {v, }} (strictly) and v, — +00, and if 


U Un— 
lim “— "=p (pe E*), 
NCO Un — Un—-1 
then also 
: Un 
lim — = 
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[Hint: The result of Problem 34, with 


Un — Un-1 
Ln = ———— _ and yn = Un — Vn-1. 
Un — Un-1 


leads to the final result.] 


37. From Problem 36 obtain a new solution for Problem 15. Also prove that 
; Ome 1 1 
lim [—s - —_ ) ==, 


[Hint: For the first part, put 
un = Smn and vn = n™*?!, 


For the second, put 


Un = (M+1)Simn —n™*? and un = n™(m+4+1),] 
38. Let 0<a<b< +oo. Define inductively: a, = Vab and b; = s(a +b); 


1 
= (Ge 4 Oy), 7 = 1, 2) 028: 


Qn41 = Vand, and by4i = 5 


Then @n41 < bn41 for 


Pa seta age 5(Vbn — tn) 


bn41 — an+1 = mt 


Deduce that 
C0 ta =< aay = 0, 


so {an}t and {b,}). By Theorem 3, an — p and b, — q for some 
p,q € E'. Prove that p = q, i.e., 


lima, = lim by. 
(This is Gauss’s arithmetic-geometric mean of a and b.) 
[Hint: Take limits of both sides in bn+1 = 4 (an + bn) to get gq = 4(p + q).] 
39. Let 0<a< bin E'. Define inductively a, = a, b; = b, 
2anb 1 
dn = —— ond ba, = (ES ses 
= EE, and bag = 5(an + bn) 


n 


Prove that 
Vab= lim a, = lim by. 
nC N—- Co 


[Hint: Proceed as in Problem 38.] 


40. Prove the continuity of dot multiplication, namely, if 


In > Gand ¥, > 7 in EB” 
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(*or in another Euclidean space; see §9), then 


En Yn > +t. 


§16. More on Cluster Points and Closed Sets. Density 


I. The notions of cluster point and closed set (§§12, 14) can be characterized 
in terms of convergent sequences. We start with cluster points. 


Theorem 1. 


(ii) A set A C (S, p) clusters at p € S iff p is the limit of some sequence {x} 
of points of A other than p; if so, the terms x, can be made distinct. 


Proof. (i) If p= limn+.%m,,, then by definition each globe about p contains 
all but finitely many x ,,, hence infinitely many £m. Thus p is a cluster point. 
Conversely, if so, consider in particular the globes 


By assumption, G,,(1) contains some x,,. Thus fix 

Lin © Gy(l): 
Next, choose a term 

il 
Drie Gp(5) with mz > mM 4. 

(Such terms exist since G,(5) contains infinitely many &m.) Next, fix 

1 

Ti = G,(=), with m3 > m2 > m1, 


and so on. 
Thus, step by step (inductively), select a sequence of subscripts 


My <™2 S++ OS My <i e 


that determines a subsequence (see Chapter 1, §8) such that 


1 1 
(Vn) 2m, € G,(=), L.€.; P(lm,3 D) < ae 0; 


| Therefore, cluster points of {am} are also called subsequential limits. 
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whence p(%m,,; Pp) > 0, or 2m, > p. (Why?) Thus we have found a subse- 
quence 2», — p, and assertion (i) is proved. 

Assertion (ii) is proved quite similarly—proceed as in the proof of Corollary 6 
in §14; the inequalities m, < m2 <--- are not needed here. UO 


Examples. 


(a) Recall that the set R of all rationals clusters at each p € E? (§14, 
Example (e)). Thus by Theorem 1(ii), each real p is the limit of a se- 
quence of rationals. See also Problem 6 of §12 for p in E”. 


(b) The sequence 
0:4: O44, 


has two convergent subsequences, 
Lon = 1 1 and ro,_-1 =0- 0. 
Thus by Theorem 1(i), it clusters at 0 and 1. 
Interpret Example (f) and Problem 10(a) in §14 similarly. 


As we know, even infinite sets may have no cluster points (take N in E'). 
However, a bounded infinite set or sequence in E” (*or C”) must cluster. This 
important theorem (due to Bolzano and Weierstrass) is proved next. 


Theorem 2 (Bolzano—Weierstrass). 


(i) Each bounded infinite set or sequence A in E” (*or C”) has at least one 
cluster point p there (possibly outside A). 


(ii) Thus each bounded sequence in E” (*C”) has a convergent subsequence. 
Proof. Take first a bounded sequence {2;,} C [a, b] in E+. Let 
p= lim 2,4. 
By Theorem 2(i) of Chapter 2, §13, {z,,} clusters at p. Moreover, as 
GS 25 = 0, 


we have 
a < inf 2, <p < sup 2m, <0 


by Corollary 1 of Chapter 2, 813. Thus 
p € (a, b] CE’, 


and so {z,} clusters in E?. 
Assertion (ii) now follows—for E1—by Theorem 1(i) above. 
Next, take 


{Zm} = a, zm = (Cis Vii V3 Im; Ym © EB. 
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If {Z,,} is bounded, all Z,, are in some square [a, b]. (Why?) Let 
a= (a1, a2) and b = (b1, bo). 


Then 
a, <2Lm < by and ag < Ym < be in E}. 


Thus by the first part of the proof, {x,,} has a convergent subsequence 
Lm, — pi for some py € |[ai, bi]. 


For simplicity, we henceforth write z,, for tm,, Ym for Ym,, and Zm for Zm,. 
Thus Zm = (2m; Ym) is now a subsequence, with 2 — pi, and ag < Ym < be, 
as before. 

We now reapply this process to {Ym} and obtain a subsubsequence 


Ym; — Pz for some pz € [ag, ba]. 


The corresponding terms 2, still tend to p; by Corollary 3 of §14. Thus we 
have a subsequence 


zm, = (lores iia) > (pi, 2) in E? 


by Theorem 2 in $15. Hence p = (pi, p2) is a cluster point of {Z,,}. Note that 
p € [a, b] (see above). This proves the theorem for sequences in E? (hence in 
Ci. 

The proof for E” is similar; one only has to take subsequences n times. 
(*The same applies to C” with real components replaced by complex ones.) 

Now take a bounded infinite set A C E” (*C”). Select from it an infinite 
sequence {Z,,} of distinct points (see Chapter 1, §9, Problem 5). By what was 
shown above, {Z,,} clusters at some point p, so each G5 contains infinitely 
many distinct points Z,, € A. Thus by definition, A clusters at p. 


Note 1. We have also proved that if {2m} C |a, b] C E”, then {2} has a 
cluster point in [a, b]. (This applies to closed intervals only.) 


Note 2. The theorem may fail in spaces other than E” (*C”). For example, 
in a discrete space, all sets are bounded, but no set can cluster. 


II. Cluster points are closely related to the following notion. 
Definition 1. 


The closure of a set A C (S, p), denoted A, is the union of A and the set 
of all cluster points of A (call it A’). Thus A= AU A’. 


Theorem 3. We have p € A in (S, p) iff each globe G,(6) about p meets A, 
4.€., 


(Vi>0) ANG,(6) 49. 
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Equivalently, p € A iff 


p= lim 2, for some {z,,} CA: 
n—->oco 


The proof is as in Corollary 6 of §14 and Theorem 1. (Here, however, the 
Ln need not be distinct or different from p.) The details are left to the reader. 
This also yields the following new characterization of closed sets (cf. §12). 


Theorem 4. A set A C (S, p) is closed iff one of the following conditions 
holds. 


(i) A contains all its cluster points (or has none); i.e., A D A’. 
(ii) A= A. 
(iii) A contains the limit of each convergent sequence {xn} C A (if any).? 


Proof. Parts (i) and (ii) are equivalent since 
ADA’ —A=AUA'=A. (Explain!) 


Now let A be closed. If p ¢ A, then p € —A; therefore, by Definition 3 in 
§12, some G,, fails to meet A (G,NA = 0). Hence no p € —A is acluster point, 
or the limit of a sequence {z,,} C A. (This would contradict Definitions 1 and 
2 of §14.) Consequently, all such cluster points and limits must be in A, as 
claimed. 

Conversely, suppose A is not closed, so —A is not open. Then —A has a 
noninterior point p; i.e., p € —A but no G, is entirely in —A. This means that 
each G, meets A. Thus 


p € A (by Theorem 3), 


and 


p= lim z, for some {z,,} C A (by the same theorem), 
n> co 


even though p € A (for p € —A). 
We see that (iii) and (ii), hence also (i), fail if A is not closed and hold if A 
is closed. (See the first part of the proof.) Thus the theorem is proved. 


The following corollaries are left as exercises (see Problems 6-9). 
Corollary 1. 6 = 0. 
Corollary 2. ACB=ACB. 
Corollary 3. A is always a closed set D A. 


? Property (iii) is often called the sequential closedness of A. 
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Corollary 4. AUB=AUB (the closure of AUB equals the union of A and 


B). 


III. As we know, the rationals are dense in E' (Theorem 3 of Chapter 2, 


§10). 


This means that every globe G,(6) = (p — 6,p +) in E' contains 


rationals. Similarly (see Problem 6 in §12), the set R” of all rational points is 
dense in E”. We now generalize this idea for arbitrary sets in a metric space 


(S, p). 


Definition 2. 


Given A C B C (S, p), we say that A is dense in B iff each globe Gp, 
p € B, meets A. By Theorem 3, this means that each p € B is in A; ice., 


p= lim 2, for some {zy} C A. 
nC 


Equivalently, AC B C A.3 


Summing up, we have the following: 


A is open iff A= A®. 
A is closed iff A = A; equivalently, iff A D A’. 
A is dense in B iff AC BCA. 
A is perfect iff A= A’.* 


Problems on Cluster Points, Closed Sets, and Density 


Nao 1 FF Ww nN 


. Complete the proof of Theorem 1 (ii). 
. Prove that R = E' and R" = E” (Example (a)). 
. Prove Theorem 2 for E%. Prove it for E” (*and C”) by induction on n. 


. Verify Note 2. 


Prove Theorem 3. 


. Prove Corollaries 1 and 2. 


. Prove that (AU B)! = A’UB’. 


[Hint: Show by contradiction that p ¢ (A’ U B’) excludes p € (AU B)’. Hence 
(AU B) C A’ UB’. Then show that A’ C (AU B)’, etc.] 


. From Problem 7, deduce that AU B is closed if A and B are. Then 


prove Corollary 4. By induction, extend both assertions to any finite 
number of sets. 


3 If B is closed (e.g., if B = S) this means that A = B. Why? 
4 See §14, the remarks following Example (i). 
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11. 


12. 


13. 
14. 


15. 


16. 


17. 
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. From Theorem 4, prove that if the sets A; (i € JI) are closed, so is 


Nie Aj. 


. Prove Corollary 3 from Theorem 3. Deduce that A = A and prove 


footnote 3. 
[Hint: Consider Figure 7 and Example (1) in §12 when using Theorem 3 (twice).] 
Prove that A is contained in any closed superset of A and is the inter- 
section of all such supersets. 
[Hint: Use Corollaries 2 and 3.] 

(i) Prove that a bounded sequence {%} C E” (*C”) converges to p 

iff p is its only cluster point. 
(ii) Disprove it for 
(a) unbounded {Z,,} and 


(b) other spaces. 


[Hint: For (i), if Zm — p fails, some Gp leaves out infinitely many Zm. These Zm 
form a bounded subsequence that, by Theorem 2, clusters at some g 4 p. (Why?) 
Thus g is another cluster point (contradiction!). 

For (ii), consider (a) Example (f) in §14 and (b) Problem 10 in §14, with (0, 2] 
as a subspace of E},] 


In each case of Problem 10 in §14, find A. Is A closed? (Use Theorem 4.) 


Prove that if {b,} C B C A in (S, p), there is a sequence {a,} C A such 
that p(an, bn) > 0. Hence a, > p iff b, — p. 
[Hint: Choose an € Gy, (1/n).] 


We have, by definition, 
p € A® iff (46 > 0) Gp (5) C A; 


hence 
p¢ A® iff (Vd > 0) Gp(6) Z A, ie., Gp(d) -AF# 9. 


(See Chapter 1, §§1-3.) Find such quantifier formulas for p € A, p ¢ A, 
pe A',and p¢ A’. 
[Hint: Use Corollary 6 in §14, and Theorem 3 in §16.] 
Use Problem 15 to prove that 

(i) —(A) = (—A)® and 

(ii) —(A°) = —A. 
Show that 

AN (—A) =bdA (boundary of A); 


cf. §12, Problem 18. Hence prove again that A is closed iff A > bd A. 
[Hint: Use Theorem 4 and Problem 16 above.| 
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*18. A set A is said to be nowhere dense in (S, p) iff (A)° = 0. Show that 
Cantor’s set P (§14, Problem 17) is nowhere dense. 
[Hint: P is closed, so P = P.] 


*19. Give another proof of Theorem 2 for E!. 
[Hint: Let A C [a, 6]. Put 


Q = {a € |a, b] | x exceeds infinitely many points (or terms) of A}. 


Show that Q is bounded and nonempty, so it has a glb, say, p= inf A. Show that A 
clusters at p.] 


*20. For any set A C (S, p) define 


Prove that 


*21. Prove that 
A={xz€S| p(x, A) =0}; see §13, Note 3. 
Hence deduce that a set A in (S, p) is closed iff 
(VxES) pla, A)=O= ced. 
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A convergent sequence is characterized by the fact that its terms x,,, become 
(and stay) arbitrarily close to its limit, as m — +00. Due to this, however, they 
also get close to each other; in fact, p(a%m, Zn) can be made arbitrarily small 
for sufficiently large m and n. It is natural to ask whether the latter property, 
in turn, implies the existence of a limit. This problem was first studied by 
Augustin-Louis Cauchy (1789-1857). Thus we shall call such sequences Cauchy 
sequences. More precisely, we formulate the following. 


Definition 1. 


A sequence {%m} C (S, p) is called a Cauchy sequence (we briefly say 
that “{x,,} is Cauchy”) iff, given any « > 0 (no matter how small), we 
have p(%m, Xn) < € for all but finitely many m and n. In symbols, 


(Ve > OQ) (GE) (a, Sh) Plan Ty) <S (1) 
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Observe that here we only deal with terms x, %,, not with any other point. 
The limit (if any) is not involved, and we do not have to know it in advance. 
We shall now study the relationship between property (1) and convergence. 


Theorem 1. Every convergent sequence {Xm} C (S, p) is Cauchy. 
Proof. Let x,, — p. Then given ¢ > 0, there is a k such that 


(Ym >k) pam; p) <5. 


As this holds for any m > k, it also holds for any other term x, with n > k. 
Thus e 
(Vm, n>k) ptm, p) < 5 and plp, tn) < 


Noo Ie) 


Adding and using the triangle inequality, we get 
P(tm; Fn) < pm, p) + e(P, En) < €, 


and (1) is proved. 
Theorem 2. Every Cauchy sequence {xm} C (S, p) is bounded. 


Proof. We must show that all x,,, are in some globe. First we try an arbitrary 
radius ¢. Then by (1), there is k such that p(am, Un) < ¢ form,n>k. Fix 
some n > k. Then 


(Vm >k) p(@m, Ln) < €, ie., fm € Gz, (Ee). 


Thus the globe G,,, (€) contains all x,, except possibly the k terms 71, ..., Xx. 
To include them as well, we only have to take a larger radius r, greater than 
P(Lm; Ln), M=1,..., k. Then all x,, are in the enlarged globe G,, (r). O 


Note 1. In £', under the standard metric, only sequences with finite limits 
are regarded as convergent. If 7, — -too, then {z,} is not even a Cauchy 
sequence in E1 (in view of Theorem 2); but in E*, under a suitable metric 
(cf. Problem 5 in §11), it is convergent (hence also Cauchy and bounded). 


Theorem 3. Jf a Cauchy sequence {x,,} clusters at a point p, then Xm — p. 


Proof. We want to show that x,, — p, i.e., that 


(ve >0) (3k) Vm>k) plan, p)<e) 


Thus we fix « > 0 and look for a suitable k. Now as {x,,} is Cauchy, there is 
a k such that 2 
(Vi OSE) Oras, tn) =< 5: 


Also, as p is a cluster point, the globe Gp(5) contains infinitely many x, 80 we 
can fix one with n > k (k as above). Then p(zn, p) < = and, as noted above, 


2 
also p(&m, In) < § for m > k. Hence 


(Vm >k) p(@m, Zn) + p(Ln, Pp) < €, 
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implying p(%m, Pp) < p(4@m;, Ln) + p(@n, p) < €, as required. O 


Note 2. It follows that a Cauchy sequence can have at most one cluster 
point p, for p is also its limit and hence unique; see 814, Corollary 1. 

These theorems show that Cauchy sequences behave very much like conver- 
gent ones. Indeed, our next theorem (a famous result by Cauchy) shows that, 
in E” (*and C”) the two kinds of sequences coincide. 


Theorem 4 (Cauchy’s convergence criterion). A sequence {Z,,} in E” (*or 
C”) converges if and only if it is a Cauchy sequence. 
Proof. If {x,,} converges, it is Cauchy by Theorem 1. 

Conversely, let {z,,} be a Cauchy sequence. Then by Theorem 2, it is 
bounded. Hence by the Bolzano—Weierstrass theorem (Theorem 2 of §16), it 


has a cluster point p. Thus by Theorem 3 above, it converges to p, and all is 
proved. O 


Unfortunately, this theorem (along with the Bolzano—Weierstrass theorem 
used in its proof) does not hold in all metric spaces. It even fails in some 
subspaces of E!. For example, we have 


1 
lm =— —>O0in El. 
m 


By Theorem 1, this sequence, being convergent, is also a Cauchy sequence. 
Moreover, it still preserves (1) even if we remove the point 0 from E? since 
the distances p(%m, Zp») remain the same. However, in the resulting subspace 
S = E' — {0}, the sequence no longer converges because its limit (and unique 
cluster point) 0 has disappeared, leaving a “gap” in its place. Thus we have a 
Cauchy sequence in S, without a limit or cluster points, so Theorem 4 fails in 
S (along with the Bolzano—Weierstrass theorem). 

Quite similarly, both theorems fail in (0, 1) (but not in [0, 1]) as a subspace 
of E'. By analogy to incomplete ordered fields, it is natural to say that S$ 
is “incomplete” because of the missing cluster point 0, and call a space (or 
subspace) “complete” if it has no such “gaps,” i.e., if Theorem 4 holds in it. 
Thus we define as follows. 


Definition 2. 
A metric space (or subspace) (5, p) is said to be complete iff every Cauchy 
sequence in S converges to some point p in S. 
Similarly, a set A C (S, p) is called complete iff each Cauchy sequence 
{£m} C A converges to some point p in A, i.e., iff (A, p) is complete as a 
metric subspace of (S, p). 


In particular, E” (*and C”) are complete by Theorem 4. The sets (0, 1) 
and E! — {0} are incomplete in E1, but [0, 1] is complete. Indeed, we have the 
following theorem. 
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*Theorem 5. 
(i) Every closed set in a complete space is complete itself. 


(ii) Every complete set A C (S, p) is necessarily closed.* 


Proof. (i) Let A be a closed set in a complete space (S, p). We have to show 
that Theorem 4 holds in A (as it does in S$). Thus we fix any Cauchy sequence 
{xm} C A and prove that it converges to some p in A. 

Now, since S is complete, the Cauchy sequence {z,,} has a limit p in S. As 
A is closed, however, that limit must be in A by Theorem 4 in §16. Thus (i) 
is proved. 

(ii) Now let A be complete in a metric space (S, p). To prove that A is 
closed, we again use Theorem 4 of 816. Thus we fix any convergent sequence 
{@m}C A, tm > p € S, and show that p must be in A. 

Now, since {z,,} converges in S, it is a Cauchy sequence, in S as well as 
in A. Thus by the assumed completeness of A, it has a limit q in A. Then, 
however, the uniqueness of lim 2, (in S) implies that p = q € A, so that p is 
in A, indeed. 7 


Problems on Cauchy Sequences 


1. Without using Theorem 4, prove that if {xz,} and {y,} are Cauchy 
sequences in E! (or C), so also are 


(i) {an + yn} and (Ul) 4d y 


2. Prove that if {x} and {ym} are Cauchy sequences in (S, pe), then the 
sequence of distances 


pl Sins Ure) m=1, 2, cian 


converges in E!. 
[Hint: Show that this sequence is Cauchy in E!; then use Theorem 4.] 


3. Prove that a sequence {2} is Cauchy in (S, p) iff 
(Ve >0) (3k) (Vm>k) p(tm, oR) <€. 


4. Two sequences {2%} and {y,} are called concurrent iff 


DP Srey tin) 0. 
Notation: {r%,} * {ym}. Prove the following. 


(i) If one of them is Cauchy or convergent, so is the other, and 
lim z, = lim ym (if it exists). 


1 Here (, p) itself need not be complete. 
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5. 


5’, 


* RM 


(ii) If any two sequences converge to the same limit, they are concur- 
rent. 


Show that if {z,,} and {ym} are Cauchy sequences in (S, ~), then 
fm pl fms Vn) 


does not change if {%m} or {ym} is replaced by a concurrent sequence 
(see Problems 4 and 2). 
Call 


lim pl fms Ym) 


m—-cO 
the “distance” 


eP({Lm};, {Ym}) 


between {x,,} and {ym}. Prove that such “distances” satisfy all met- 
ric axioms, except that p({@m}, {Ym}) may be 0 even for different se- 
quences. (When?) 

Also, show that if 


(Vm) 2m =a and Ym = b (constant), 


then p({tm}, {Ym}) = pla, 6). 


Continuing Problems 4 and 5, show that the concurrence relation (~) 
is reflexive, symmetric, and transitive (Chapter 1, §§4—7), i.e., an equiv- 
alence relation. That is, given {%m}, {ym} in S, prove that 


(a) {fm} & {fm} (reflexivity); 
(b) if {am} {ym} then {ym} % {tm} (symmetry); 


(c) if {tm} = {ym} and {ym} = {zm}, then {r,,} = {zm} (transitiv- 
ity). 


From Problem 4 deduce that the set of all sequences in (S, p) splits into 
disjoint equivalence classes (as defined in Chapter 1, §§4-7) under the 
relation of concurrence (=). Show that all sequences of one and the 
same class either converge to the same limit or have no limit at all, and 
either none of them is Cauchy or all are Cauchy. 


. Give examples of incomplete metric spaces possessing complete sub- 


spaces. 


. Prove that if a sequence {x} C (S, p) is Cauchy then it has a subse- 


quence {2} such that 


(Vk) P(lmy, Emp 41) a aie 


. Show that every discrete space (.S, p) is complete. 
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"12. 
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Let C be the set of all Cauchy sequences in (5, 9); we denote them by 
capitals, e.g., X = {Lm}. Let 


X*={YeEC|Y xX} 


denote the equivalence class of X under concurrence, * (see Problems 2, 
5’, and 5’). We define 


o(X*, ¥*) = ol{tm}s (mh) = lim pltms Ym): 


By Problem 5, this is unambiguous, for p({%m}, {ym}) does not de- 
pend on the particular choice of {z,,} € X* and {ym} € Y*; and 
lim p(2m, Ym) exists by Problem 2. 

Show that o is a metric for the set of all equivalence classes X* 
(X € C); call this set C*. 


Continuing Problem 9, let x* denote the equivalence class of the se- 
quence with all terms equal to x; let C’ be the set of all such “constant” 
equivalence classes (it is a subset of C*). 


Show that C’ is dense in (C*, a), i.e., C’ = C* under the metric o. 
(See $16, Definition 2.) 
[Hint: Fix any “point” X* € C* and any globe G(X*;¢) about X* in (C*, a). We 
must show that it contains some x* € C’. 


By definition, X* is the equivalence class of some Cauchy sequence X = {xm} in 


(S, p), sO 


(Ak) (Vm, n>k) p(am, tn) < = 


Fix some x = &p (n > k) and consider the equivalence class «* of the sequence 
{x, @,..., v,...}; thus, x* € C’, and 


€ 
7 
Thus «* € G(X™*, €), as required.] 


Two metric spaces (5, p) and (T, a) are said to be isometric iff there is 
amap f:S “>? T such that 
onto 


(Va,yEeS) pla, y) =o(f(x), fly)). 


Show that the spaces (S, p) and (C’, a) of Problem 10 are isometric. 
Note that it is customary not to distinguish between two isometric 
spaces, treating each of them as just an “isometric copy” of the other. 
Indeed, distances in each of them are alike. 

[Hint: Define f(x) = 2*.] 


Continuing Problems 9 to 11, show that the space (C*, a) is complete. 
Thus prove that for every metric space (S, p), there is a complete metric 
space (C*, a) containing an isometric copy C’ of S, with C’ dense in 
C*. C* is called a completion of (5, p). 
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[Hint: Take a Cauchy sequence {X;*,} in (C*,o). By Problem 10, each globe 
G(Xs; +) contains some z*, € C’, where x*, is the equivalence class of 

{Bin Bins oe kimi ad 
and o(X*,, a7) < + — 0. Thus by Problem 4, {x*,} is Cauchy in (C*, o), as is 


{X%,}. Deduce that X = {am} EC, and X* = lim X> in (C*, o).] 
m—-> co 


Chapter 4 
Function Limits and Continuity 


§1. Basic Definitions 


We shall now consider functions whose domains and ranges are sets in some 
fixed (but otherwise arbitrary) metric spaces (S, p) and (T, p’), respectively. 
We write 

PAS, e) 


for a function f with Ds = A C (S, p) and Di C (T, p’). S is called the 
domain space, and T the range space, of f. 


I. Given such a function, we often have to investigate its “local behavior” 
near some point p € S. In particular, if p €¢ A = Dy (so that f(p) is defined) we 
may ask: Is it possible to make the function values f(x) as near as we like (“e- 
near”) to f(p) by keeping x sufficiently close (“d-close” ) to p, i.e., inside some 
sufficiently small globe G,,(6)?" If this is the case, we say that f is continuous 
at p. More precisely, we formulate the following definition. 


Definition 1. 


A function f: A > (T, p’), with A C (S, p), is said to be continuous at 
p iff p € A and, moreover, for each ¢ > 0 (no matter how small) there is 
5 >0 such that p’( f(x), f(p)) < € for all « € ANG,(6). In symbols, 


p'( f(x), f(p)) <e, or 
FQ) — Gray) 


(Ve >0) (Ad > 0) (Vz € ANG, (6)) { (1) 


If (1) fails, we say that f is discontinuous at p and call p a discontinuity 
point of f. This is also the case if p €¢ A (since f(p) is not defined). 

If (1) holds for each p in a set B C A, we say that f is continuous on B. If 
this is the case for B = A, we simply say that f is continuous. 


1 Of course, for f(z) to exist, z must also be in A = Dy; thus x € ANGp(6). We say that 
x is 6-close to p iff p(x, p) < 6. 
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Sometimes we prefer to keep x near p but different from p. We then replace 
G,(6) in (1) by the set G,(d) — {p}, ie., the globe without its center, denoted 
G,(6) and called the deleted 6-globe about p. This is even necessary if p ¢ Df. 
Replacing f(p) in (1) by some q € T, we then are led to the following definition. 


Definition 2. 
Given f: A — (T, p’), A C (S, p), p € S, and q € T, we say that f(z) 
tends to q as x tends to p (f(x) > qas x — p) iff for each ce > 0 there is 
5) >0 such that p’( f(x), g) <« for all x € ANG_,(6). In symbols, 

p'( f(z), q) <é, ie., 

f(@) € Gale). 


(Ve >0) (46 >0) (Vz € ANG.,,(8)) { (2) 


This means that f(x) is e-close to q when x is 6-close to p and x # p.? 


If (2) holds for some q, we call q a limit of f at p. There may be no such gq. 
We then say that f has no limit at p, or that this limit does not exist. If there 
is only one such q (for a given p), we write q = lim f(a). 

«—p 


Note 1. Formula (2) holds “vacuously” (see Chapter 1, §§81-3, end remark) 
if AM G_p(d) = 0 for some 6 > 0. Then any gq € T is a limit at p, so a limit 
exists but is not unique. (We discard the case where T is a singleton.) 


Note 2. However, uniqueness is ensured if ANG_»(d) #0 for all 6 > 0, as 
we prove below. 


Observe that by Corollary 6 of Chapter 3, §14, the set A clusters at p iff 
(Vd >0) ANG_,(6) #0. (Explain!) 
Thus we have the following corollary. 


Corollary 1. Jf A clusters at p in (S, p), then a function f: A — (T, p’) can 
have at most one limit at p; 1.e., 


lim f(x) is unique (if it exists).° 
xwL—p 


In particular, this holds if A D (a, b) C E' (a < b) and p € {a, BI. 
Proof. Suppose f has two limits, gq and r, at p. By the Hausdorff property, 
Gi(é)G-(e) =0 for some e > 0. 
Also, by (2), there are 6’, 6” > 0 such that 
(Vz € ANG.,(5')) f(x) € G(e) and 
(Vz € ANG.,(6")) f(x) € G,(e). 
~ 2 Ghserve that the choice of © depends on Sin both Cl)’and @). 


3 Because of this, some authors restrict Definition 2 to the case where A clusters at p. 
However, this has its disadvantages (e.g., Corollary 2 fails). 
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Let 6 = min(0’, 6’). Then for x € ANG_,(6), f(x) is in both G,(e) and G;,(e), 
and such an x exists since AM G.»(d) £ 0 by assumption. 


But this is impossible since Gy(¢) MN G,(e) = 0 (a contradiction!). 


For intervals, see Chapter 3, §14, Example (h). 
Corollary 2. f is continuous at p (p € Dr) iff f(x) > f(p) as x > p. 
The straightforward proof from definitions is left to the reader. 


Note 3. In formula (2), we excluded the case x = p by assuming that 
x € ANG_,(6). This makes the behavior of f at p itself irrelevant. Thus for 
the existence of a limit q at p, it does not matter whether p € Dy or whether 
f(p) =¢q. But both conditions are required for continuity at p (see Corollary 2 
and Definition 1). 


Note 4. Observe that if (1) or (2) holds for some 6, it certainly holds for 
any 0’ <6. Thus we may always choose 6 as small as we like. Moreover, as 
x is limited to G,(6), we may disregard, or change at will, the function values 
f(a) for « ¢ G,(6) (“local character of the limit notion” ). 

II. Limits in E*. If S or T is E* (or E'), we may let x > +too or 
f(x) — too. For a precise definition, we rewrite (2) in terms of globes Gp and 
Ge 

(7¥G,) (Gy) VHEANGH)° faye Gz (2’) 


This makes sense also if p = +oo or gq = +oo. We only have to use our 
conventions as to G4.., or the metric p’ for E*, as explained in Chapter 3, §11. 


For example, consider 
“F(z) 3 qasx—4 +o” (ACS=E*, p=+00,q€ (T, p’)). 


Here G,, has the form (a, +oo], a € E', and G.y = (a, +00), while G, = G,(e), 
as usual. Noting that x € G_, means x > a (x € E'), we can rewrite (2) as 


(Ve >0) (Jae E')(VrEAlx>a) f(x) EG, (6), or p'(f(z), gd <e. (3) 


This means that f(x) becomes arbitrarily close to q for large x (x > a). 
Next consider “f(x) — +oo as x — —oo.” Here Gp = (—oo, a) and 
Gq = (b, +00]. Thus formula (2’) yields (with S = T = E*, and & varying over 
FE") 
(Vbe E') (Gac E') Vee Ala<a) f(x)>b; (4) 


similarly in other cases, which we leave to the reader. 


Note 5. In (3), we may take A = N (the naturals). Then f: N — (T, p’) 
is a sequence in T. Writing m for x, set Um = f(m) anda=k € N to obtain 


(Ve >0) (Ak) Vm>k) um € G,(e); ie, p'(um, g) <e. 
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This coincides with our definition of the limit q of a sequence {u,,} (see 
Chapter 3, §14). Thus limits of sequences are a special case of function limits. 
Theorems on sequences can be obtained from those on functions f: A —> (T, p’) 
by simply taking A = N and S = E* as above. 


Note 6. Formulas (3) and (4) make sense also if S = E! (respectively, 
S =T = E') since they do not involve any mention of -too. We shall use such 
formulas also for functions f: A > T, with A C S C E! or T C E!, as the 
case may be. 


III. Relative Limits and Continuity. Sometimes the desired result (1) 
or (2) does not hold in full, but only with A replaced by a smaller set B C A. 
Thus we may have 


(Ve >0) (45 >0) (V2 EBNG»(5)) f(x) €G,(e). 


In this case, we call q a relative limit of f at p over B and write 
“f(x) + qas x —p over B” 


or 
lim f(x)=q_ (if q is unique); 
z—>p,xeB 

B is called the path over which x tends to p. If, in addition, p € Dy and 
q = f(p), we say that f is relatively continuous at p over B; then (1) holds 
with A replaced by B. Again, if this holds for every p € B, we say that f 
is relatively continuous on B. Clearly, if B = A = Dy, this yields ordinary 
(nonrelative) limits and continuity. Thus relative limits and continuity are 
more general. 

Note that for limits over a path B, x is chosen from B or B — {p} only. 
Thus the behavior of f outside B becomes irrelevant, and so we may arbitrarily 
redefine f on —B. For example, if p ¢ B but lim;_,p, cep f(x) = q exists, we 
may define f(p) = q, thus making f relatively continuous at p (over B). We 
also may replace (S, p) by (B, p) (if p € B), or restrict f to B, i.e., replace 
f by the function g: B — (T, p’) defined by g(x) = f(x) for x € B (briefly, 
g=f on B)4 

A particularly important case is 


ACSCE*,eg.,S=E'. 
Then inequalities are defined in S, so we may take 


B={x¢€A|z <p} (points in A, preceding p). 


4 The function g is called the restriction of f to B denoted fg or f|g. Thus f is relatively 
continuous on B iff fg is continuous. 
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Then, writing G, for Gy(e) and a = p — 6, we obtain from formula (2) 


(VG,) (da<p)(VtEAla<a<p) f(r) eG. (5) 


If (5) holds, we call q a left limit of f at p and write 
“f(z) >qasx—>p ” (“x tends to p from the left”). 
If, in addition, gq = f(p), we say that f is left continuous at p. Similarly, taking 
B={xreEA|la>p}, 
we obtain right limits and continuity. We write 
f(x) > q asx — pt 


iff q is a right limit of f at p, i-e., if (5) holds with all inequalities reversed. 

If the set B in question clusters at p, the relative limit (if any) is unique. 
We then denote the left and right limit, respectively, by f(p~) and f(p*), and 
we write 


lim f(z) = f(p~) and lim, f(x) = f(p*). (6) 


xp x—pt 
Corollary 3. With the previous notation, if f(x) > q as x > p over a path 


B, and also over D, then f(x) > q as x > p over BUD. 
Hence if Dp C E* and p € E*, we have 


q= lim f(x) if ¢= f(~) = f(*). (Exercise! 


We now illustrate our definitions by a diagram in E? representing a function 
f: E! = E' by its graph, i.e., points (x, y) such that y = f(z). 
Here 
Gil) =(¢-8, 4+ 8) 


is an interval on the y-azis. The dotted lines show how to construct an interval 
(p—6,p+6)=G, 


on the x-axis, satisfying formula (1) in Figure 13, formulas (5) and (6) in 
Figure 14, or formula (2) in Figure 15. The point Q in each diagram belongs 
to the graph; i.e., Q = (p, f(p)). In Figure 13, f is continuous at p (and also at 
pi). However, it is only left-continuous at p in Figure 14, and it is discontinuous 
at p in Figure 15, though f(p~) and f(p*) exist. (Why?) 


Examples. 
(a) Let f: A— T be constant on B C A; ice., 


f(x) =q for a fixed q € T and all z € B. 
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gate A 
q1 
qe 
qte 
Q | 
q | | 
. boot 
2 | | | 
SS ee ee 
O p—o Pp pto Pl 
FIGURE 13 
f(a 
(x) ae 
qte 
‘ Q 
No a eet 
—— 
O p—o px pt+o 
FIGURE 14 


Then f is relatively continuous on B, and f(x) > q as x > p over B, at 
each p. (Given ¢ > 0, take an arbitrary 6 > 0. Then 


(VrE BNG_p(6)) f(r) =q€ Ge), 


as required; similarly for continuity. ) 


(b) Let f be the identity map on A C (5, p); ie., 


WaEA) flr) =a. 
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Q 
f(p) ° 

qte : 
q | | 
_. | | 
ITE | | 
= ae 

O p—o p pt+oé 

FIGURE 15 


Then, given ¢ > 0, take 6 = € to obtain, for p € A, 


(Vae ANG,(6)) plf(x), fp) = plz, p) <d =e. 
Thus by (1), f is continuous at any p € A, hence on A. 
Define f: E1 > E! by 
f(x) = 1 if x is rational, and f(x) = 0 otherwise. 
(This is the Dirichlet function, so named after Johann Peter Gustav Leje- 


une Dirichlet.) 
No matter how small 6 is, the globe 


Gp(d) = (p— 4, p+ 4) 


(even the deleted globe) contains both rationals and irrationals. Thus as 
x varies over G_»(6), f(a) takes on both values, 0 and 1, many times and 
so gets out of any G,(e), with g € E', e < 3. 

Hence for any q, p € E', formula (2) fails if we take ¢ = 7 say. Thus 
f has no limit at any p € E! and hence is discontinuous everywhere! 
However, f is relatively continuous on the set FR of all rationals by Exam- 
ple (a). 
Define f: E1 > E' by 


f(x) = [a] (= the integral part of x; see Chapter 2, §10). 


Thus f(z) = 0 for x € [0,1), f(z) = 1 for x € [1, 2), etc. Then f is 
discontinuous at p if p is an integer (why?) but continuous at any other 
p (restrict f to a small G,(0) so as to make it constant). 
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However, left and right limits Yy 


\ 
exist at each p € E', even if p = 34 — 
n (an integer). In fact, 
25 e— > 
f(x) =n, x € (n,n+1) | 
and ait | ‘i 
— —_ —_ @ SJ | 
f(z) =n-1,2€(n-1,7n), . oe 
hence f(n+) = n and f(n-) = 
n—1; f is right continuous on ene 
E'. See Figure 16. 
(ec) Define f: E1 > E' by 
a= ‘al if x £0, and f(0) =0. 
a4 


(This is the so-called signum function, often denoted by sgn.) 


Then (Figure 17) 
f(z) =—-lifz#<0 Yn 


and 
e = 
fea lig> 0. O x 
‘ , 1 
Thus, as in (d), we infer that f 7 
is discontinuous at 0, but con- 
FIGURE 17 


tinuous at each p # 0. Also, 
f(0t) = 1 and f(0-) = —1. Redefining f(0) = 1 or f(0) = —1, we 
can make f right (respectively, left) continuous at 0, but not both. 


(f) Define f: E' + E' by (see Figure 18) 


jaS= sin ~ ie 0, anid 7(0)=0. 


Any globe Go(6) about 0 con- 


tains points at which f(z) = er 

1, as well as those at which 1 > 
f(x) = —1 or f(x) = 0 (take 

x = 2/(nz) for large integers n); O . x 
in fact, the graph “oscillates” in- ; 

finitely many times between —1 


and 1. Thus by the same argu- 


ment as in (c), f has no limit at FIGURE 18 
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2’. 


0 (not even a left or right limit) and hence is discontinuous at 0. No 
attempt at redefining f at 0 can restore even left or right continuity, let 
alone ordinary continuity, at 0. 


Define f: E? > E' by 
U1%X2 


f(0) =0 and f(z) = eae He = (45 5) D. 


Let B be any line in E? through 0, given parametrically by 
g=—ti, t€ E', @ fixed (see Chapter 3, §§4-6), 


so £1 = tu, and x2 = tug. As is easily seen, for  € B, f(x) = f(a) 
(constant) if z #0. Hence 


(V@E BNG9(9)) f(@) = fl), 


ie., p(f(Z), f(u)) = 0 < «, for any e¢ > 0 and any deleted globe about 0. 

By (2’), then, f(z) > f(u) as Z — 0 over the path B. Thus f has a 
relative limit f(u) at 0, over any line 7 = tu, but this limit is different 
for various choices of U, i.e., for different lines through 0. No ordinary 
limit at 0 exists (why?); f is not even relatively continuous at 0 over the 
line = tu unless f(u) = 0 (which is the case only if the line is one of 
the coordinate axes (why?)). 


Problems on Limits and Continuity 


. Prove Corollary 2. Why can one interchange G,(6) and G_»(6) here? 


. Prove Corollary 3. By induction, extend its first clause to unions of n 


paths. Disprove it for infinite unions of paths (see Problem 9 in §3). 


Prove that a function f: E+ > (T, p’) is continuous at p iff 


. Show that relative limits and continuity at p (over B) are equivalent 


to the ordinary ones if B is a neighborhood of p (Chapter 3, §12); for 
example, if it is some Gp. 


. Discuss Figures 13-15 in detail, comparing f(p), f(p~), and f(p™); see 


Problem 2’. 


Observe that in Figure 13, different values of 6 result at p and p, for 
the same ¢. Thus 6 depends on both € and the choice of p. 


. Complete the missing details in Examples (d)-(g). In (d), redefine f(z) 


to be the least integer > x. Show that f is then left-continuous on E!. 
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6. Give explicit definitions (such as (3)) for 


(a) lim f (2) = —co: (b) lim f(x) = 4; 
(c) lim f(x) = +00; (A) lim f (2) = -o03 
(e) Jim_f(z) = +00: (f) Jim, f(2) = oe, 


In each case, draw a diagram (such as Figures 13-15) and determine 
whether the domain and range of f must both be in E*. 
7. Define f: E! — E! by 
g? —1 
ji2)= i tee 1, and f(1) =0. 

2 —. 
Show that lim,_,; f(z) = 2 exists, yet f is discontinuous at p = 1. Make 
it continuous by redefining f(1). 


[Hint: For « £1, f(~) = «+1. Proceed as in Example (b), using the deleted globe 
Gop(9).] 


8. Find lim,_,, f(a) and check continuity at p in the following cases, assum- 
ing that Dy = A is the set of all x € E! for which the given expression 
for f(x) has sense. Specify that set.° 


on + 2 
a : 
(a) lim(22*- 32-5); (b) tim 32 * 2, 
2_4 xz? —8 
Ge Oo 
xz*— a‘ : 
i f) li ( e 
(e) a r—a os ett x+1 
li = ° 
(@) lim, (aq) - 
2 
[Example solution: Find lim ae = 
cl 24+3 
Here 5 
ee ee ee es ee 
f(@) = Fy A= BY - {5} pal. 


We show that f is continuous at p, and so (by Corollary 2) 
4 
a= Tat 


Using formula (1), we fix an arbitrary « > 0 and look for a 6 such that 


5a2-1 4 
Sea fea 


(Wee ANG) p(f(@),f()) =1f@)- F@)| <e, ie, [ES - = 


5In (d) and (e), p ¢ A, yet one can restore continuity as in Problem 7. (Reduce the 
fraction by x — p for x # p and define f(p) accordingly.) 
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or, by putting everything over a common denominator and using properties of abso- 
lute values, 


|252 + 17| 


< e€ whenever |x — 1] <d andawe A. (6) 
5[2a + 3| 


lc — 1 
(Usually in such problems, it is desirable to factor out x — p.) 
By Note 4, we may assume 0 < 6 < 1. Then |x — 1| < 6 implies -1 <a—-—1< 1, 
ie., O<a@< 2,50 
5 |2a + 3] > 15 and |25a2 + 17| < 67. 


Hence (6) will certainly hold if 


67 . : 15e 
jc — 1] — <e,ie., if |x —1]| < —. 
15 67 


To achieve it, we choose 6 = min(1, 15<¢/67). Then, reversing all steps, we obtain 
(6), and hence lim f(x) = f(1) = 4/5. 
Poe 


9. Find (using definitions, such as (3)) 


; ; 32+ 2 
2) oe x’ Dy ga or — 1’ 
x? x-1 
hi d) ili 
(c) epee 1— 72’ ( ) ec | 
—1 —1 
(ce) lim = ; (f) lim aa 
r33- 4-3 z>3l ar — 3 


10. Prove that if 
lim f(a) = € E” (*C”), 


then for each scalar c, 


11. Define f: E! > E! by 
1 
f(x) =a-sin— if x #40, and f(0) =0. 
Zz 


Show that f is continuous at p = 0, i.e., 


hin fF (a) = fF (0) 0: 


xz—0 
Draw an approximate graph (it is contained between the lines y = +2). 
[Hint: |a - sin ii 0| < |a].] 
xv 
*12. Discuss the statement: f is continuous at p iff 


(VGyip)) (AGp)  fIG@p] CS Gr). 
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13. 


14. 


15. 


16. 
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Define f: E1 > E' by 
f(@)=2 il a is rational 


and 
f(x) = 0 otherwise. 


Show that f is continuous at 0 but nowhere else. How about relative 
continuity? 


Let A = (0, +00) C E?. Define f: A > E* by 
f(x) = 0 if z is irrational 

and 

1 

f{(@)=—it ¢= he (in lowest terms) 

n n 
for some natural m and n. Show that f is continuous at each irrational, 
but at no rational, point p € A. 


[Hints: If p is irrational, fix ¢ > 0 and an integer k > 1/e. In Gp(1), there are only 
finitely many irreducible fractions 


m 
— >O0withn<k, 
n 

so one of them, call it r, is closest to p. Put 
6 = min(1, |r — pl) 


and show that 
(VE ANGp(S)) |f(e)— flp)| = fle) <e, 


distinguishing the cases where ~ is rational and irrational. 


If p is rational, use the fact that each G,(d) contains irrationals « at which 
f(x) = 0 = |f(@) — Ff) = fe). 


Take e < f(p).] 


Given two reals, p > 0 and q > 0, define f: E! > E! by 
~ (2). 12) 4 
f(0) =0 and fa)= (5) B if « # 0; 


here [q/z] is the integral part of q/z. 
(i) Is f left or right continuous at 0? 


(ii) Same question with f(x) = [x/p|(q/z). 


Prove that if (.S, p) is discrete, then all functions f: S — (T, p’) are 
continuous. What if (7, p’) is discrete but (S, p) is not? 
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§2. Some General Theorems on Limits and Continuity 


I. In 81 we gave the so-called “ce, 6” definition of continuity. Now we present 
another (equivalent) formulation, known as the sequential one. Roughly, it 
states that f is continuous iff it carries convergent sequences {%m}C Dy into 
convergent “image sequences” { f(Z)}. More precisely, we have the following 
theorem. 


Theorem 1 (sequential criterion of continuity). (i) A function 
f:A-(T, p’), with AC (S, p), 


is continuous at a point p € A iff for every sequence {%} C A such that 
Lm —> p in (S, p), we have f(am) > f(p) in (T, p’). In symbols, 


(V{tm}CA|am—>p) f(tm) > fp). (1’) 
(ii) Similarly, a point q € T is a limit of f at p (p€ S) iff 
(V{tm} CA-{p} | mp) fam) > 4. (2’) 


Note that in (2’) we consider only sequences of terms other than p. 


Proof. We first prove (ii). Suppose q is a limit of f at p, ie. (see §1), 
(Ve >0) (46 >0) Va Ee ANG_,»(5)) f(x) € G,(e). (2) 


Thus, given ¢ > 0, there is 6 > 0 (henceforth fixed) such that 
f(a) € Gy(e) whenever x € A, x #p, and x € G, (6). (3) 
We want to deduce (2’). Thus we fix any sequence 
{tm} A—{p}, &m > Dp.’ 


Then 
(Gm) t € Aand ty, Dp, 


and G,(d) contains all but finitely many xm. Then these x, satisfy the con- 
ditions stated in (3). Hence f(%m) € Gg(e) for all but finitely many m. As ¢€ 
is arbitrary, this implies f(z) — q (by the definition of lim f(2,,)), as is 
required in (2’). Thus (2) => (2’). a 

Conversely, suppose (2) fails, i.e., its negation holds. (See the rules for 
forming negations of such formulas in Chapter 1, 81-3.) Thus 


(Ge >0) (V6 >0) (Av € ANG.(5)) f(x) EG, (e) (4) 


1 Tf no such sequence exists, then (2’) is vacuously true and there is nothing to prove. 
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by the rules for quantifiers. We fix an € satisfying (4), and let 
Omg = —) MH 1 2ysces 


By (4), for each 6,, there is t, (depending on dm) such that 


1 
Lm E AN C-»(—) (5) 
and 
Tam) € Glo), M=1, 2,3; 4%: (6) 
We fix these z,,. AS %, € A and x, ~ p, we obtain a sequence 


Also, aS @m € G,(+), we have p(tm, p) < 1/m — 0, and hence 2, — p. 
On the other hand, by (6), the image sequence {f(xm)} cannot converge to q 
(why?), i.e., (2’) fails. Thus we see that (2’) fails or holds accordingly as (2) 
does. 

This proves assertion (ii). Now, by setting g = f(p) in (2) and (2’), we also 
obtain the first clause of the theorem, as to continuity. 


Note 1. The theorem also applies to relative limits and continuity over a 
path B (just replace A by B in the proof), as well as to the cases p = +oo 
and gq = +oo in E* (for E* can be treated as a metric space; see the end of 
Chapter 3, §11). 

If the range space (T, p’) is complete (Chapter 3, §17), then the image 
sequences { f(2,,)} converge iff they are Cauchy. This leads to the following 
corollary. 


Corollary 1. Let (T, p’) be complete, such as E”. Let a map f: AT with 
A C (S, p) and a point p € S be given. Then for f to have a limit at p, 
it suffices that {f(%m)} be Cauchy in (T, p’) whenever {rm} C A — {p} and 
Lm — p in (S, p). 

Indeed, as noted above, all such {f(xz,,)} converge. Thus it only remains to 
show that they tend to one and the same limit q, as is required in part (ii) of 
Theorem 1. We leave this as an exercise (Problem 1 below). 


“Theorem 2 (Cauchy criterion for functions). With the assumptions of Corol- 
lary 1, the function f has a limit at p iff for each « > 0, there is 6 > 0 such 
that 

o' (f(x), f(a’)) <e for all z, 2’ € ANG_,(65).? 


In symbols, 


(Ve >0) (46 >0) (Va, a €ANG»(5)) o'(F(2), F(@))<e (7) 


? That is, f(a) is e-close to f(a’) when « and 2’ are 6-close to p, but not equal to p. 
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Proof. Assume (7). To show that f has a limit at p, we use Corollary 1. Thus 
we take any sequence 
{tm} C A-—{p} with tm —- p 
and show that {f(x ,)} is Cauchy, i.e., 
(Ve>0) Gk) Wmn>k) on). fGen) <=. 


To do this, fix an arbitrary « > 0. By (7), we have 
(Va, 2 €EANG»(5)) o'(f (a), f(2’)) <e, (7') 
for some 6 > 0. Now as 2, — p, there is k such that 
(Vm Sk) tin; BoE Gold). 
As {zm} C A— {p}, we even have tm, In € AN G.,(d). Hence by (7’), 
(Vm,n>k) p'(f(tm), f(@n)) < é 


i.e., {f(@m)} is Cauchy, as required in Corollary 1, and so f has a limit at p. 
This shows that (7) implies the existence of that limit. 


The easy converse proof is left to the reader. (See Problem 2.) O 


II. Composite Functions. The composite of two functions 
f:S—7T and g:T-U, 


denoted 
gof (in that order), 


is by definition a map of S into U given by 
(gof\(z)=9(f(z)), seS. 


Our next theorem states, roughly, that go f is continuous if g and f are. We 
shall use Theorem 1 to prove it. 


Theorem 3. Let (S, p), (T, p’), and (U, p”) be metric spaces. If a function 
f:S5—T is continuous at a point p € S, and ifg: T + U is continuous at the 
point q = f(p), then the composite function go f is continuous at p. 


Proof. The domain of go f is S. So take any sequence 
{tm} C S with tm > p. 


As f is continuous at p, formula (1’) yields f(a) > f(p), where f(x) is in 
T = D,. Hence, as g is continuous at f(p), we have 


g(f(tm)) > 9(f(p)), i-e., (9° f)(am) > (9° f)(p), 


and this holds for any {x,,} C S with 2, > p. Thus go f satisfies condition 
(1’) and is continuous at p. O 
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Caution: The fact that 


lim f(z) =9 and limg(y) =r 
yq 


«Lp 
does not imply 


lim g(f(#)) =r 


xrL—->p 


(see Problem 3 for counterexamples). 

Indeed, if {tm} C S—{p} and tm — p, we obtain, as before, f(xm) — gq, but 
not f(a%m) #q. Thus we cannot re-apply formula (2) to obtain g(f(am)) > r 
since (2’) requires that f(%m) #q. The argument still works if g is continuous 
at q (then (1) applies) or if f(x) never equals q (then f(tm) # q). It even 
suffices that f(x) 4 q for x in some deleted globe about p (see §1, Note 4). 
Hence we obtain the following corollary. 


Corollary 2. With the notation of Theorem 3, suppose 
f(z) > q asx > p, and g(y) > Tr as y > q. 


Then 
g(f(2)) +r as x — p, 
provided, however, that 
(i) g is continuous at q, or 
(ii) f(a) #q for x in some deleted globe about p, or 
(iii) f is one to one, at least when restricted to some G_»(0). 


Indeed, (i) and (ii) suffice, as was explained above. Thus assume (iii). Then 
f can take the value q at most once, say, at some point 


Lo € Gap(d). 
As xo # p, let 
6’ = p(xo, p) > 0. 
Then x9 ¢ G.p(6’), so f(x) # gq on G_p(d’), and case (iii) reduces to (ii). 
We now show how to apply Corollary 2. 
Note 2. Suppose we know that 


r = lim g(y) exists. 
yg 


Using this fact, we often pass to another variable x, setting y = f(x) where f 
is such that ¢ = lim;-_,, f(x) for some p. We shall say that the substitution (or 
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“change of variable”) y = f(x) is admissible if one of the conditions (i), (ii), or 
(iii) of Corollary 2 holds. Then by Corollary 2, 


lim g(y) =r = lim g(f(zx)) 


y>q =p 


(yielding the second limit). 


Examples. 
(A) Let 
1\z 
hay = @ + -) for |x| > 1. 
Then 
im, h(g) =e. 


For a proof, let n = f(x) = [a] be the integral part of x. Then for 
x> 1, 


1 n 1 n+1 
(1 + —) = hr) Ss (1 + —) . (Verify!) (8) 
As x — +00, n tends to +00 over integers, and by rules for sequences, 


: Lars . il 1\” ; 1\7 
lim (1+) = lim (1+-)(1+-) =1- lim (1+ =) =il+e=<, 
noo n noo n n N—- oo nm 
with e as in Chapter 3, §15. Similarly one shows that also 
: 1 4 
lim (1 + —_ ) =€ 
n— oo n+l 


Thus (8) implies that also lim h(a) =e (see Problem 6 below). 
L—->+00 


Remark. Here we used Corollary 2(ii) with 


f(x) = [a], q= +00, and g(n) = (14+>)". 


The substitution n = f(x) is admissible since f(x) = n never equals +o, its 
limit, thus satisfying Corollary 2(ii). 


(B) Quite similarly, one shows that also 
1\2 
lim (1 + —) =¢ 
L——CO x 
See Problem 5. 


3In particular, the so-called linear substitution y = ax + b (a, b € E', a £ 0) is always 
admissible since f(a) = ax + b yields a one-to-one map. 
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(C) In Examples (A) and (B), we now substitute x = 1/z. This is admissible 
by Corollary 2(ii) since the dependence between x and z is one to one. 
Then 


1 
z=—-— 307 asx +00, andz>0° asx > —oo. 
xe 
Thus (A) and (B) yield 


lim (1+2)/*% = lim (1+ 2z)/* =e. 


z—0F z—0- 


Hence by Corollary 3 of $1, we obtain 


: 1l/z _ 
lim (1 + 2) =—— (9) 


More Problems on Limits and Continuity 


1. Complete the proof of Corollary 1. 
[Hint: Consider {f(am)} and {f(z},,)}, with 


Im —>pand zi, > p. 
By Chapter 3, §14, Corollary 4, p is also the limit of 
21,04, 22, £5,..., 
so, by assumption, 
f(x1), f(v), ... converges (to q, say). 
Hence {f(zm)} and {f(z/,,)} must have the same limit g. (Why?)| 


*2. Complete the converse proof of Theorem 2 (cf. proof of Theorem 1 in 
Chapter 3, §17). 


3. Define f, g: E' > E' by setting 
(i) f() = 2; gy) = 3 ify # 2, and g(2) = 0; or 
(ii) f(a) = 2 if x is rational and f(x) = 2x otherwise; g as in (i). 


In both cases, show that 


lim f(a) = 2 and lim g(y) = 3 but not lim g(f(x)) = 3.4 
a1 yo? r1 


4. Prove Theorem 3 from “e, 6” definitions. Also prove (both ways) that if 
f is relatively continuous on B, and g on f[B], then go f is relatively 
continuous on B. 


4Tn case (ii), disprove the existence of limy +1 g(f(2)). 
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5. Complete the missing details in Examples (A) and (B). 
[Hint for (B): Verify that 


(65) “Ga “40 =Ctaes) =e 
=>6. Given f, g,h: A- E*, A C(S, p), with 


f(a) < h(x) < g(x) 
for x € G.p(6) NA for some 6 > 0. Prove that if 


lim f(z) = lim 9(z) = 4, 


then also 


Use Theorem 1. 
[Hint: Take any 
{zm} C A— {p} with rm — p. 


Then f(t%m) > gq, 9(@m) — q, and 
(Vam € ANGop(6))  f(@m) < h(am) < g(@m). 
Now apply Corollary 3 of Chapter 3, §15.] 


=>7. Given f,g: A E*, AC (S, p), with f(x) > q and g(x) > rasx > p 
(p € S), prove the following: 


(i) Ifq>r, then 
(4d >0) V2 € ANG_,(4)) f(x) > g(z). 


(ii) (Passage to the limit in inequalities.) If 


(Vd > 0) Ax € ANGQp(6)) f(z) < g(a), 


then q < r. (Observe that here A clusters at p necessarily, so the 
limits are unique.) 
[Hint: Proceed as in Problem 6; use Corollary 1 of Chapter 3, §15.] 


8. Do Problems 6 and 7 using only Definition 2 of §1. 
[Hint: Here prove 7(ii) first.] 


9. Do Examples (a)—(d) of §1 using Theorem 1. 
[Hint: For (c), use also Example (a) in Chapter 3, §16.] 


10. Addition and multiplication in E! may be treated as functions 
fig: B 3 E 
with 
f(z, y) =at+y and g(x, y) = zy. 


168 Chapter 4. Function Limits and Continuity 


Show that f and g are continuous on E? (see footnote 2 in Chapter 3, 
815). Similarly, show that the standard metric 
p(z,y) = |e —y| 


is a continuous mapping from E? to E!. 
[Hint: Use Theorems 1, 2, and, 4 of Chapter 3, §15 and the sequential criterion.] 


11. Using Corollary 2 and formula (9), find lim (1 + mzx)'/* for a fixed m € 
N. H ie 


=>12. Let a> 0 in E!. Prove that iim eae 
[Hint: Let n = f(a) be the integral part of + (x #0). Verify that 
a er) 2g < @/” ita > 1, 
with inequalities reversed if 0 < a < 1. Then proceed as in Example (A), noting that 
jim a" =1= lim ave) 
by Problem 20 of Chapter 3, §15. (Explain!)] 
=> 13. Given f, g: A E*, AC (S, p), with 
i =@ tore inG-l0) 1A: 
Prove that 
(a) if lim f(x) = +00, then also lim g(@) = +00; 
(b) af lim g(z) = —oo, then also pes f(z) = —o. 
Do it it two ways: 
(i) Use definitions only, such as (2’) in §1. 
(ii) Use Problem 10 of Chapter 2, §13 and the sequential criterion. 
=> 14. Prove that 
(i) ifa>1in E', then 


x —ax@ 


a a 
lim —=-+o00 and lim = 0; 
Z—+oo @ t—>+oo FZ 
(ii) if 0<a<1, then 
a” a” 
lim —z=0Oand lim = +00; 
Z—>+co @ Z—>+oo 


(iii) ifa>1and0<qeé E’, then 


a” a” 
lim —=-+o0 and lim = 0; 
z—+oo 79 z—>+oo 77 
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(iv) if0<a<land0<qeé FE’, then 


x 


[Hint: (i) From Problems 17 and 10 of Chapter 3, §15, obtain 


_ a” 
lim — = +00. 
n 


Then proceed as in Examples (A)-(C); (iii) reduces to (i) by the method used in 
Problem 18 of Chapter 3, §15.] 

=>*15. For a map f: (5, p) > (T, p’), show that the following statements are 
equivalent: 


(i) f is continuous on S. 


(ii) (VAC S) fA] C f[A]. 

Gn) (7¥8-CT) f*(Bl > 7-18, 

(iv) f~*[B] is closed in (S, p) whenever B is closed in (T, p’). 
(v) f~1[B] is open in (S, p) whenever B is open in (T, p’). 


[Hints: (i) => (ii): Use Theorem 3 of Chapter 3, §16 and the sequential criterion to 
show that 


pe A= f(p)€ fA). 
(ii) => (iii): Let A = f—![B]. Then f[A] C B, so by (ii), 


f[A] C f[A] CB. 


Hence 


~T[F[A]]  f*[B]. (Why?) 


(iii) => (iv): If B is closed, B = B (Chapter 3, §16, Theorem 4(ii)), so by (iii), 


f-*[B] = f~‘[B] D f-1[B]; deduce (iv). 


(iv) = > (v): Pass to complements in (iv). 
(v) => (i): Assume (v). Take any p € S and use Definition 1 in §1.] 


16. Let f: E! — E' be continuous. Define g: E! + E? by 
g(x) = (a, f(x). 
Prove that 
(a) g and g 
(b) the range of g, i.e., the set 
D, = {(z, f(#)) | 2 € E’}, 


' are one to one and continuous; 


is closed in E?. 


[Hint: Use Theorem 2 of Chapter 3, §15, Theorem 4 of Chapter 3, §16, and the 
sequential criterion.] 
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I. A function f: A — T is said to be real if its range dD; lies in E', complex 
if D; CC, vector valued if D; is a subset of E”, and scalar valued if D; lies in 
the scalar field of E”. (*In the latter two cases, we use the same terminology if 
E” is replaced by some other (fixed) normed space under consideration.) The 
domain A may be arbitrary. 

For such functions one can define various operations whenever they are de- 
fined for elements of their ranges, to which the function values f(x) belong. 
Thus as in Chapter 3, §9, we define the functions ftg, fg, and f/g “pointwise,” 
setting 


(f £9)(2) = fle) £.4(0), (Fo)(e) = Fla) 9(a), and (2) (a) = 2 


whenever the right side expressions are defined. We also define |f|: 4 > E' 
by 
(Vee A) |fl() =|F(2)I- 


In particular, f+g is defined if f and g are both vector valued or both scalar 
valued, and fg is defined if f is vector valued while g is scalar valued; similarly 
for f/g. (However, the domain of f/g consists of those x € A only for which 


g(x) # 0.) 
In the theorems below, all limits are at some (arbitrary, but fixed) point p 
of the domain space ($, ¢). For brevity, we often omit “x — p.” 
Theorem 1. For any functions f, g,h: A— E*(C), AC (S, p), we have the 
following: 
(i) If f, g, h are continuous at p (p € A), so are f +g and fh. So also is 
f/h, provided h(p) 4 0; similarly for relative continuity over BC A. 
(ii) If f(z) > q, g(x) > 1, and h(x) > a (all, as x > p over B C A), then 
(a) f( 
(b) f(x)h(x) > qa; and 
f(t) 4 


(c) Gy => 7 provided a # 0. 


%) = g(t) > qr; 


All this holds also if f and g are vector valued and h is scalar valued. 


For a simple proof, one can use Theorem 1 of Chapter 3, §15. (An indepen- 
dent proof is sketched in Problems 1-7 below.) 

We can also use the sequential criterion (Theorem 1 in §2). To prove (ii), 
take any sequence 


nays B= {Pp}, Lm —> p. 
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Then by the assumptions made, 

f(@m) 4 9, 9(&m) 47, and h(Lm) > a. 
Thus by Theorem 1 of Chapter 3, 815, 
f (tm) = q 


g(Zm) a 


f(@m) + 9(@m) 9g +1, f(tm)g(4m) > qa, and 


As this holds for any sequence {z,,} C B — {p} with z,, > p, our assertion 
(ii) follows by the sequential criterion; similarly for (i). 


Note 1. By induction, the theorem also holds for sums and products of any 
finite number of functions (whenever such products are defined). 


Note 2. Part (ii) does not apply to infinite limits q, r, a; but it does apply 
to limits at p = oo (take E* with a suitable metric for the space S). 


Note 3. The assumption h(x) — a 4 0 (as x > p over B) implies that 
h(x) € 0 for x in BM G_,(6) for some 6 > 0; see Problem 5 below. Thus the 
quotient function f/h is defined on BMG —p(6) at least. 


II. If the range space of f is E” (*or C”), then each function value f(x) is 
a vector in that space; thus it has n real (*respectively, complex) components, 
denoted 
npeecae r=, 2D, ed agetes 


Here we may treat f, as a mapping of A = Dy into E! (*or C); it carries 
each point x € A into f;,(x), the kth component of f(z). In this manner, each 
function 
f: A7 E” (C”) 
uniquely determines n scalar-valued maps 
fri A E' (C), 
called the components of f. Notation: f = (fi, ..-, fn). 
Conversely, given n arbitrary functions 
FIASE C),. H1, scum; 
one can define f: A> E” (C”) by setting 


f(x) = (fil@), fal), -.-5 fr(x)). 


Then obviously f = (fi, fo, ..., fr). Thus the f;, in turn determine f uniquely. 
To define a function f: A— E” (C”) means to give itsn components f;,. Note 
that 


f(a) =(A@), 5 fa@) =) ef), te, f=) exfe, (1) 
k=1 k=1 
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where the é, are the n basic unit vectors; see Chapter 3, 881-3, Theorem 2. 
Our next theorem shows that the limits and continuity of f reduce to those of 
the ice 


Theorem 2 (componentwise continuity and limits). For any function f: A —> 
E” (C™), with A C (S, p) and with f = (fi, ..-, fn), we have that 


(i) f is continuous at p (p € A) iff all its components f, are, and 
(ii) f(v) >G asx p (pES) iff 
f(t) > Qe ast—>p (k=1,2,...,n), 
e., iff each fy has, as its limit at p, the corresponding component of q. 


Similar results hold for relative continuity and limits over a path B C A. 


We prove (ii). If f(z) > gas x > p then, by definition, 


(Ve >0) (46 >0) VrE ANG-7(5)) €>|f(z)-al= yf Doleto )- al? ; 


in turn, the right-hand side of the inequality given above is no less than each 


lfx(@) — Gel, k=1,2,...,n 


Thus 


(Ve >0) (Ad >0) (Va €EANGp(6)) | fe(a) — axl < & 


ie., fr(@) > qe, K=1,..., 0. 
Conversely, if each f(a) > qx, then Theorem 1(ii) yields 


S° ex fe (x) => So exgn-! 

k=1 k=1 
By formula (1), then, f(x) + ¢ (for )77_1 gx = @). Thus (ii) is proved; 
similarly for (i) and for relative limits and continuity. 


Note 4. Again, Theorem 2 holds also for p = +oo (but not for infinite q). 


Note 5. A complex function f: A — C may be treated as f: A > E?. 
Thus it has two real components: f = (f1, fo). Traditionally, f; and fo are 
called the real and imaginary parts of f, also denoted by fre and fim, so 


f =. ie +4 Fina 
By Theorem 2, f is continuous at p iff fre and fim are. 


| Here we treat @ as a constant function, with values é, (cf. §1, Example (a)). 
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Example. 


The complex exponential is the function f: E! — C defined by 
f(z) =cosa+i-sinz, also written f(x) = e*. 


As we shall see later, the sine and the cosine functions are continuous. 
Hence so is f by Theorem 2. 


III. Next, consider functions whose domain is a set in E” (*or C”). We call 
them functions of n real (“or complex) variables, treating Z = (a1, ..., @p) as 
a variable n-tuple. The range space may be arbitrary. 

In particular, a monomial in n variables is a map on £” (*or C™) given by 
a formula of the form 


n 
f (2) 00)" 2,7 +22 = a- I] eo 
k=1 


where the m, are fixed integers > 0 and a € E! (*ora € C).? If a 4 0, the 
sum m= >-/_, mx is called the degree of the monomial. Thus 


i (ais 2) = 3272 yz? = 3x7y1z3 


defines a monomial of degree 6, in three real (or complex) variables z, y, 2. 
(We often write x, y, z for x1, Xe, £3.) 

A polynomial is any sum of a finite number of monomials; its degree is, by 
definition, that of its leading term, i.e., the one of highest degree. (There may 
be several such terms, of equal degree.) For example, 


f(a, y, 2) = 807 y2" — 2xy’ 


defines a polynomial of degree 8 in x, y, z. Polynomials of degree 1 are some- 
times called linear. 

A rational function is the quotient f/g of two polynomials f and g on E” 
(*or C”).° Its domain consists of those points at which g does not vanish. For 
example, 


defines a rational function on points (z, y), with zy # 1. Polynomials and 
monomials are rational functions with denominator 1. 


Theorem 3. Any rational function (in particular, every polynomial) in one 
or several variables is continuous on all of its domain. 


2 We also allow a to be a vector, while the x, are scalars. 
3 This is valid also if one allows the coefficients of f to be vectors (provided those of g, 
and the variables x,, remain scalars). 
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Proof. Consider first a monomial of the form 
f(z) = we. (hk feed): 


it is called the kth projection map because it “projects” each z € E” (*C”) 
onto its kth component xp. 
Given any € > 0 and p, choose 6 = ¢€. Then 


(VEE Gp(9)) |F() — F(P)| = le — pel S 


Hence by definition, f is continuous at each p. Thus the theorem holds for 
projection maps. 
However, any other monomial, given by 


f(®) = aap ag? aR, 


is the product of finitely many (namely of m = m1+m2+--:+m,) projection 
maps multiplied by a constant a. Thus by Theorem 1, it is continuous. So 
also is any finite sum of monomials (i.e., any polynomial), and hence so is 
the quotient f/g of two polynomials (i.e., any rational function) wherever it is 
defined, i.e., wherever the denominator does not vanish. 


IV. For functions on E” (*or C”), we often consider relative limits over a 
line of the form 


x=p+té&, (parallel to the kth axis, through p); 


see Chapter 3, §84—6, Definition 1. If f is relatively continuous at p over that 
line, we say that f is continuous at p in the kth variable x, (because the other 
components of % remain constant, namely, equal to those of p, as X runs over 
that line). As opposed to this, we say that f is continuous at p in alln variables 
jointly if it is continuous at p in the ordinary (not relative) sense. Similarly, 
we speak of limits in one variable, or in all of them jointly. 

Since ordinary continuity implies relative continuity over any path, joint 
continuity in all n variables always implies that in each variable separately, 
but the converse fails (see Problems 9 and 10 below); similarly for limits at p. 


Problems on Continuity of Vector- Valued Functions 


1. Give an “e, 6” proof of Theorem 1 for f + g. 
[Hint: Proceed as in Theorem 1 of Chapter 3, §15, replacing max(k’, k’’) by 6 = 
min(6’, 6’). Thus fixe >0 and pé S. If f(x) > q and g(x) > r as x 4 p over B, 
then (46’,6” > 0) such that 


(Vz € BNG-p(5')) | f(x) —al < 5 and (Vz € BNG.,(6"))_ |g(z) —r| < - 


Put 6 = min(0’, 6”), etc.] 
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In Problems 2, 3, and 4, F = E” (*or another normed space), F' is its scalar 
field, BC A C(S, p), and x > p over B. 


2. For a function f: A > EF prove that 
f(t) +4 = |f(x)-4| > 9, 
equivalently, iff f(x) — q — 0. 
[Hint: Proceed as in Chapter 3, §14, Corollary 2.] 


3. Given f: A > (T, p’), with f(x) > q as x > p over B. Show that for 
some 6 > 0, f is bounded on BM G_,(d), ie., 


f[BOG_,(6)] is a bounded set in (T, p’). 
Thus if T = FE, there is K € E' such that 
(Vz € BNG_»(0)) |f(x)|< K 
(Chapter 3, §13, Theorem 2). 
4. Given f,h: A E' (C) (or f: A> E, h: A— F), prove that if one 


of f and h has limit 0 (respectively, 0), while the other is bounded on 


BOG_,(6), then h(a) f(x) — 0 (0). 


5. Given h: A > E! (C), with h(x) > a as x > p over B, and a F 0. 
Prove that 


——~ 


Je,6 >0) (V2 EBNG.(6)) |a(x)| >, 


ie., h(x) is bounded away from 0 on BM G_,(6). Hence show that 1/h 


is bounded on BN G.y(6). 
[Hint: Proceed as in the proof of Corollary 1 in §1, with g =a and r =0. Then use 


(Va € BNG+(6)) rol < =] 


6. Using Problems 1 to 5, give an independent proof of Theorem 1. 
[Hint: Proceed as in Problems 2 and 4 of Chapter 3, §15 to obtain Theorem 1(ii). 
Then use Corollary 2 of §1.] 


7. Deduce Theorems 1 and 2 of Chapter 3, §15 from those of the present 
section, setting A= B= N, S = E*, and p= +00. 
[Hint: See §1, Note 5.] 
8. Redo Problem 8 of §1 in two ways: 
(i) Use Theorem 1 only. 
(ii) Use Theorem 3. 
[Example for (i): Find lim («* +1). 


Here f(z) = 22 +1, or f = gg +h, where h(x) = 1 (constant) and g(x) = x 
(identity map). As h and g are continuous (§1, Examples (a) and (b)), so is f by 
Theorem 1. Thus lim fa)y=f0)=1? +1=2, 

=> 
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Or, using Theorem 1(ii), lima (a? +1)= lim, ge lim, 1, etc.] 
= i ea Oe 


9. Define f: E? > E! by 


a 


= 
(x* + y?) 
Show that f(x, y) > 0 as (a, y) > (0, 0) along any straight line through 
0, but not over the parabola y = x? (then the limit is 4). Deduce that 


a 2 
f is continuous at 0 = (0, 0) in z and y separately, but not jointly. 


10. Do Problem 9, setting 


13.0) = , with f(0,0) = 0. 


f(x, y) =0 if « =0, and f(a, y) = Wl tule? ig a #04 


2 


11. Discuss the continuity of f: E? + E! in x and y jointly and separately, 


at 0, when 
(@) Fle, v) = Fs, £10, 0) = 6: 
(b) f(z, y) = integral part of x + y; 
(c) Sey) =2+ 7 ite £0, £0, y) =0: 
td) fie y) = ial + sin if cy £0, and f(z, y) = 0 otherwise; 


(e) f(x, y) = sin(a? +|xy|) if 2 #0, and f(0, y) = 0. 


[Hints: In (c) and (d), |f(a, y)| < || + |y|; in (e), use | sina] < |al.] 


4Use Problem 14 in §2 for limit computations. 
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§4. Infinite Limits. Operations in E* 


As we have noted, Theorem 1 of §3 does not apply to infinite limits,! even if 
the function values f(x), g(x), h(x) remain finite (i.e., in E'). Only in certain 
cases (stated below) can we prove some analogues. 

There are quite a few such separate cases. Thus, for brevity, we shall adopt 
a kind of mathematical shorthand. The letter g will not necessarily denote a 
constant; it will stand for 


“a function f: A> E', AC (S, p), such that f(r) > q € E' asx p.”? 
Similarly, “O” and “too” will stand for analogous expressions, with q replaced 
by 0 and +co, respectively. 

For example, the “shorthand formula” (+00) + (+00) = +00 means 

“The sum of two real functions, with limit +oo at p (p € S), is itself a 


function with limit +00 at p.”° 


The point p is fixed, possibly too (if A C E*). With this notation, we have 
the following theorems. 


Theorems. 
1. (400) + (400) = +00. 
2. (too) + ¢=q + (+00) = too. 
3. (+00) - (400) = +00. 
Ay (00) « (4-60) = —Go. 
5. | +00] = +00. 
G. (200) -9 = ¢= ($00) = oor gS 0 
1. (#00) +9 =q= (400) = poo 7g <0 
8. —(+00) = Foo 
9. ——— = (+00) - = ifq #0 
10. Tes) =0 
11. (+00)t™ = +00 
12. (+00)~-° = 0. 
13. (+00)4 = +00 ifq >0 


1 It even has no meaning since operations on +oo have not been defined. 
? Note that q is finite throughout. 
3 Similarly for (—oo) + (—oo) = —oo. Both combined are written as “(+oo) + (too) = 


=koo.” 
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14, (+00)? =0 ifq <0. 
15. Ifq > 1, then gt™ = +00 and q © =0. 
16. [f0<q<1, thengt® =0 andq © = +00. 


We prove Theorems | and 2, leaving the rest as problems. (Theorems 11—16 
are best postponed until the theory of logarithms is developed.) 


1. Let f(x) and g(a) + +00 as x + p. We have to show that 
f(x) + g(@) > +00, 


i.e., that 


(VbeE E') (A6>0) Vx €E ANG_,(5)) f(x) + g(x) > b 


(we may assume b > 0). Thus fix b > 0. As f(x) and g(x) — +00, there 
are 0’, 0” > 0 such that 


(Va € ANG_,(0')) f(x) > b and (Vx € ANG_,(6”)) g(a) > b. 
Let 6 = min(0’, 6”). Then 
(Vee ANG p(6)) f(r) + g(x) >b+b> b, 


as required; similarly for the case of —oo. 


2. Let f(x) 4 +00 and g(x) + q € E?. Then there is 6’ > 0 such that for 
xz in AN G_»p(0’), |¢— g(z)| < 1, so that g(z) > q—-1. 
Also, given any b € E!, there is 6” such that 


(VE ANG.,(6")) f(x) >b-—qH4tl. 
Let 6 = min(0’, 6”). Then 
(Vee ANG p(6)) fla)+g(@) > b-a+)+(q-) =, 
as required; similarly for the case of f(a) — —oo. 


Caution: No theorems of this kind exist for the following cases (which there- 
fore are called indeterminate expressions): 
too 86 OO 


a a (+00)?°, u, J=X. (1*) 


(+00) + (—o0), (+00) - 0, 


In these cases, it does not suffice to know only the limits of f and g. It 
is necessary to investigate the functions themselves to give a definite answer, 
since in each case the answer may be different, depending on the properties of 
f and g. The expressions (1*) remain indeterminate even if we consider the 
simplest kind of functions, namely sequences, as we show next. 
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Examples. 
(a) Let 
Um = 2m and vm = —mM. 


(This corresponds to f(z) = 2x and g(a) = —x.) Then, as is readily seen, 

Um — +00, Um > —00, and Um + Um = 2M —-M=mM-> +00. 
If, however, we take x, = 2m and y,, = —2m, then 

Im + Ym = 2m — 2m = 0; 

thus 2m+Ym is constant, with limit 0 (for the limit of a constant function 
equals its value; see §1, Example (a)). 

Next, let 

Um = 2m and zm = —2m+ (-1)”™. 
Then again 
Um — +00 and Zm — —0oo, but Um + 2m = (-1)"; 

Um + 2m “oscillates” from —1 to 1 as m + +00, so it has no limit at all. 

These examples show that (+00) + (—oo) is indeed an indeterminate 


expression since the answer depends on the nature of the functions in- 
volved. No general answer is possible. 


(b) We now show that 1*° is indeterminate. 


Take first a constant {tm}, 2m = 1, and let yn =m. Then 
CS Ue SS ee, Od ee I Sa Lae, 


If, however, 2, = 1+ + and y, = m, then again y,, > +00 and £, > 1 
(by Theorem 10 above and Theorem 1 of Chapter 3, 815), but 


1 m 
Lo = (1+ —) 
m 


does not tend to 1; it tends to e > 2, as shown in Chapter 3, §15. Thus 
again the result depends on {x} and {ym}. 


In a similar manner, one shows that the other cases (1*) are indeterminate. 
Note 1. It is often useful to introduce additional “shorthand” conventions. 
Thus the symbol oo (unsigned infinity) might denote a function f such that 
|f(x)| 4 +00 as x > p; 


we then also write f(x) — oo. The symbol 0* (respectively, 0~) denotes a 
function f such that 
f(z) > O0asx—p 
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and, moreover, 
f(x) > 0 (f(a) < 0, respectively) on some Gip(d). 


We then have the following additional formulas: 


ie CEOS) (oo) _ 
(i) a +00, | a 
(ii) If q > 0, then “+ = +00 and a = —0o0o. 
(iii) =~ = 0. 
Gy SU, 
00 


The proof is left to the reader. 


Note 2. All these formulas and theorems hold for relative limits, too. 
So far, we have defined no arithmetic operations in E*. To fill this gap 
(at least partially), we shall henceforth treat Theorems 1-16 above not only as 
certain limit statements (in “shorthand” ) but also as definitions of certain op- 
erations in E*. For example, the formula (+00) + (+00) = +o shall be treated 
as the definition of the actual sum of +00 and +oo0 in E*, with +oo regarded 
this time as an element of E* (not as a function). This convention defines the 
arithmetic operations for certain cases only; the indeterminate expressions (1*) 
remain undefined, unless we decide to assign them some meaning. 
In higher analysis, it indeed proves convenient to assign a meaning to at 
least some of them. We shall adopt these (admittedly arbitrary) conventions: 
(00) + (00) = (400) — (+00) = +00; 0° = 1; = 
{ 0 - (400) = (400) - 0 = 0 (even if 0 stands for the zero-vector). 2") 


Caution: These formulas must not be treated as limit theorems (in “short- 
hand”). Sums and products of the form (2*) will be called “unorthodox.” 


Problems on Limits and Operations in E* 
1. Show by examples that all expressions (1*) are indeterminate. 


2. Give explicit definitions for the following “unsigned infinity” limit state- 
ments: 


(a) lim f(a) = 60; (b) lim f(x) = 00; (c) lim f(x) =0oo. 


Zp x—pt L—> Co 


3. Prove at least some of Theorems 1-10 and formulas (i)—(iv) in Note 1. 
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4. In the following cases, find lim f(x) in two ways: (i) use definitions only; 
(ii) use suitable theorems and justify each step accordingly. 


en tah . a(a-1 
O) eee SD () Jim Ta 
ge? —Qe+1 _ 22 -Iw+l 
(c) Ban xv? —37+2- (d) ae xv? — 32 +2- 
oe: 1 
(A fee ee: 


z32 ¢2 —374+2 


[Hint: Before using theorems, reduce by a suitable power of z.] 


5. Let 
f(a) = So aga* and g(x) = 5° bya (an £0, bm # 0). 
k=0 k=0 
Find Jim -— if (i) n > m; (ii) n < m; and (iii) n =m (n, mE N). 


6. Verify commutativity and associativity of addition and multiplication 
in E*, treating Theorems 1-16 and formulas (2*) as definitions. Show 
by examples that associativity and commutativity (for three terms or 
more) would fail if, instead of (2*), the formula (co) + (Foo) = 0 were 
adopted. 

[Hint: For sums, first suppose that one of the terms in a sum is +00; then the sum 


is +oo. For products, single out the case where one of the factors is 0; then consider 
the infinite cases.] 


7. Continuing Problem 6, verify the distributive law (x+ y)z = #z+ yz in 
E*, assuming that x and y have the same sign (if infinite), or that z > 0. 
Show by examples that it may fail in other cases; e.g., if s = —y = +00, 
z=-l. 


§5. Monotone Functions 


A function f: A > E*, with A C E”*, is said to be nondecreasing on a set 
BCA iff 


x <y implies f(x) < f(y) for z, y € B. 
It is said to be nonincreasing on B iff 
x <y implies f(x) > f(y) for 2, y € B. 


Notation: ff and f| (on B), respectively. 
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In both cases, f is said to be monotone or monotonic on B. If f is also one 
to one on B (i.e., when restricted to B), we say that it is strictly monotone 
(increasing if ft and decreasing if f1). 

Clearly, f is nondecreasing iff the function —f = (—1)f is nonincreasing. 
Thus in proofs, we need consider only the case ft. The case f| reduces to it 
by applying the result to —f. 

Theorem 1. /f a function f: A— E* (A C E*) is monotone on A, it has a 
left and a right (possibly infinite) limit at each point p € E*. 
In particular, if ft on an interval (a, b) #0, then 


fp) = sup f(x) for p € (a, 9] 
ax<x<p 


and 
+) = anf b). 
Flp") = int , f(x) for p € a, 8) 
(In case f|, interchange “sup” and “inf.” ) 


Proof. To fix ideas, assume ff. 

Let p € E* and B={x € A| a < p}. Put q = sup f[B] (this sup always 
exists in E*; see Chapter 2, §13). We shall show that q is a left limit of f at p 
(i.e., a left limit over B). 

There are three possible cases: 


(1) If q is finite, any globe G, is an interval (c, d), c <q <d, in E'. As 
c <q =supf|B], c cannot be an upper bound of f|B] (why?), so c is 
exceeded by some f(zo), ro € B. Thus 


6< 7 (tp), 5 =D: 
Hence as ft, we certainly have 
e< feo) < f(a) for all g > ao (Ee B). 
[B], we have 
(x) < sup f[B] =¢ <d, 


soe< f(a) <a: ie, f(a) € (Gd) = Gz. 
We have thus shown that 


(VG,) (Ato<p)(V2EBlao<z) f(x) € Gy, 


Moreover, as f(x) € 


bg 
f 


so q is a left limit at p. 
(2) If ¢ = +00, the same proof works with Gy = (c, +00]. Verify! 
(3) If g = —oo, then 
(VxeB) f(x) <sup f[B] = —o, 
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ie., f(z) < —oo, so f(x) = —oo (constant) on B. Hence q is also a left 
lirintt at p (81, fosgrale (a 


ra et 


In ‘particular, if ff om A = (a, 18) with a,b € E* anda < 6b, then B = 
(a, p) for p € (a, b]. Here p is a cluster point of the path B (Chapter 3, §14, 
Example (h)), so a unique left limit f(p~) exists. By what was shown above, 


q=f(p )=supf[B] = sup f(z), as claimed. 
ax<xr<p 


Thus all is proved for left limits. 
The proof for right limits is quite similar; one only has to set 


B={2E€A|ao>p}, ¢= int f |S). 


Note 1. The second clause of Theorem 1 holds even if (a, 6) is only a 
subset of A, for the limits in question are not affected by restricting f to (a, b). 
(Why?) The endpoints a and 6 may be finite or infinite. 


Note 2. If Dp = A= N (the naturals), then by definition, f: N > E* isa 
sequence with general term 2, = f(m), m € N (see §1, Note 2). Then setting 
p = +co in the proof of Theorem 1, we obtain Theorem 3 of Chapter 3, §15. 
(Verify!) 

Example. 


The exponential function F : E! —-> E' to the base a > 0 is given by 
F(a) = 0°. 


It is monotone (Chapter 2, §§11-12, formula (1)), so F(0~) and F(0*) 
exist. By the sequential criterion (Theorem 1 of §2), we may use a suitable 
sequence to find F(0+), and we choose x, = + > 0+. Then 


1 
F(0+) = lim F(—) = lim al/™=1 
m 


m—- co m—- oo 


(see Chapter 3, 815, Problem 20). 
Similarly, taking x, = —+ — 0-, we obtain F(0~) = 1. Thus 


FO \=FO y= lim, P@) = ima® = 1, 
x2 


x0 


(See also Problem 12 of §2.) 
Next, fix any p € E'. Noting that 


P= =¢ fada" 


we set y = x — p. (Why is this substitution admissible?) Then y > 0 as 
xr — p, SO we get 


lim F(z) = lima? . lim a" S=¢ imo =o° sl =a =p). 
«—p y—0 
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As lim,, F(x) = F(p), F is continuous at each p € E'. Thus ail 
exponentials are continuous. 


Theorem 2. /f a function f: A > E* (A C E*) is nondecreasing on a finite 
or infinite interval B = (a, b) C A and if p € (a, b), then 
JO VaTe Sips fe <7), (1) 


and for no x € (a, b) do we have 


f(p~) < f(x) < fp) or fp) < f(a) < fp"); 
similarly in case f | (with all inequalities reversed). 


Proof. By Theorem 1, ff on (a, p) implies 
fla*) = inf f(x) and f(p~) = sup f (0); 
a<x<p 


ax<xr<p 


thus certainly f(at) < f(p-). As ft, we also have f(p) > f(x) for all x € 
(a, p); hence 


f(p) = sup f(x) = fp’). 


a<a<p 
Thus 
flat) < fe) < fF); 
similarly for the rest of (1). 
Moreover, if a < x < p, then f(x) < f(p—) since 
f(p") = sup f(z). 


ax<xr<p 


If, however, p < x < 6b, then f(p) < f(x) since ft. Thus we never have 
f(p-) < f(x) < f(p). Similarly, one excludes f(p) < f(x) < f(pt). This 
completes the proof. O 


Note 8. If f(p—), f(p*), and f(p) exist (all finite), then 


If (p) — f(p-)| and | fe") — f()| 
are called, respectively, the left and right jumps of f at p; their sum is the 
(total) jump at p. If f is monotone, the jump equals |f(pt) — f(p—)]. 
For a graphical example, consider Figure 14 in §1. Here f(p) = f(p~ ) (both 
finite), so the left jump is 0. However, f(pt) > f(p), so the right jump is 
greater than 0. Since 


f(p) = f(p-) = lim f(z), 


LI—->p~ 


f is left continuous (but not right continuous) at p. 


1Tn other words, the interval [f(p~), f(p+)] contains no f(x) except f(p). 
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Theorem 3. /f f: A— E* is monotone on a finite or infinite interval (a, b) 
contained in A, then all its discontinuities in (a, b), if any, are “jumps,” that 
is, points p at which f(p—) and f(p*) exist, but f(p~) # f(p) or f (pt) F f(p).? 
Proof. By Theorem 1, f(p~) and f(p*) exist at each p € (a, 0). 

If, in addition, f(p~) = f(pt) = f(p), then 


lim f(e) = f(P) 


by Corollary 3 of §1, so f is continuous at p. Thus discontinuities occur only 


if f(p-) A f(p) or f(pT) F f(p). 


Problems on Monotone Functions 


1. Complete the proofs of Theorems 1 and 2. Give also an independent 
(analogous) proof for nonincreasing functions. 


2. Discuss Examples (d) and (e) of $1 again using Theorems 1-3. 


3. Show that Theorem 3 holds also if f is piecewise monotone on (a, b), 
i.e., monotone on each of a sequence of intervals whose union is (a, b). 


4. Consider the monotone function f defined in Problems 5 and 6 of Chap- 
ter 3, §11. Show that under the standard metric in E', f is continuous 
on E! and f~! is continuous on (0, 1). Additionally, discuss continuity 
under the metric p’. 


=>5. Prove that if f is monotone on (a, b) C E*, it has at most countably 
many discontinuities in (a, b). 
[Hint: Let ft. By Theorem 3, all discontinuities of f correspond to mutually disjoint 
intervals (f(p—), f(p*)) #0. (Why?) Pick a rational from each such interval, so 
these rationals correspond one to one to the discontinuities and form a countable set 
(Chapter 1, §9)]. 


6. Continuing Problem 17 of Chapter 3, §14, let 


Gum (2,2), dum (5.2); dam (f, 8) snteoms 


that is, Gy; is the ith open interval removed from [{0, 1] at the mth step 


of the process (= 1, 2,...,2-*, m =1, 2, .... ad infinitum). 
Define F': [0, 1] + E! as follows: 
(i) F(O) = 0; 
21-1, 


(ii) if v € Gry, then F(x) = > and 


am 


2 Note that f(p—) and f(p+) may not exist if f is not monotone. See Examples (c) and 
(f) in §1. 
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(iii) if ¢ is in none of the Gy, (ie., x € P), then 


F(z) = sup{ F(y) lye LJGmis y < a}. 


Show that F’ is nondecreasing and continuous on [0, 1]. (F' is called 
Cantor’s function.) 


7. Restate Theorem 3 for the case where f is monotone on A, where A is 
a (not necessarily open) interval. How about the endpoints of A? 


86. Compact Sets 


We now pause to consider a very important kind of sets. In Chapter 3, 816, 
we showed that every sequence {Z,,} taken from a closed interval [@, b] in BE” 
must cluster in it (Note 1 of Chapter 3, §16).1 There are other sets with the 
same remarkable property. This leads us to the following definition. 


Definition 1. 
A set A C (S, p) is said to be sequentially compact (briefly compact) iff 
every sequence {x,,} C A clusters at some point p in A. 
If all of S is compact, we say that the metric space (S, p) is compact.” 


Examples. 
(a) Each closed interval in E" is compact (see above). 


(a’) However, nonclosed intervals, and E” itself, are not compact. 

For example, the sequence 2, = 1/n is in (0, 1] C E!, but clusters 
only at 0, outside (0, 1]. As another example, the sequence x, = n has 
no cluster points in E'. Thus (0, 1] and E! fail to be compact (even 
though E' is complete); similarly for E” (*and C”). 


(b) Any finite set A C (S, p) is compact. Indeed, an infinite sequence in such 
a set must have at least one infinitely repeating term p € A. Then by 
definition, this p is a cluster point (see Chapter 3, $14, Note 1). 


(c) The empty set is “vacuously” compact (it contains no sequences). 


(d) E* is compact. See Example (g) in Chapter 3, $14. 
Other examples can be derived from the theorems that follow. 


1 Think of [a, b] as of a container so “compact” that it “squeezes” into clustering any 
sequence that is inside it, and it supplies the cluster point. 

? Hence A is compact iff (A, p) is compact as a subspace of (5, p). Note that {xm} clusters 
at p iff there is a subsequence 4m, — p (Chapter 3, §16, Theorem 1). 
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Theorem 1. /f a set B C (S, p) is compact, so is any closed subset A C B. 


Proof. We must show that each sequence {xz,,} C A clusters at some p € A. 
However, as A C B, {x,,} is also in B, so by the compactness of B, it clusters 
at some p € B. Thus it remains to show that p € A as well. 

Now by Theorem 1 of Chapter 3, §16, {xz,,} has a subsequence 2, — p. 
As {%m,} C A and A is closed, this implies p € A (Theorem 4 in Chapter 3, 
§16). O 


Theorem 2. Every compact set A C (S, p) is closed. 


Proof. Given that A is compact, we must show (by Theorem 4 in Chapter 3, 
816) that A contains the limit of each convergent sequence {%m} C A. 

Thus let tm > p, {2m} C A. As A is compact, the sequence {z,,} clusters 
at some q € A, i.e., has a subsequence x, + q € A. However, the limit of the 
subsequence must be the same as that of the entire sequence. Thus p= q € A; 
i.e., p is in A, as required. 


Theorem 3. Every compact set A C (S, p) is bounded. 


Proof. By Problem 3 in Chapter 3, $13, it suffices to show that A is contained 
in some finite union of globes. Thus we fix some arbitrary radius ¢ > 0 and, 
seeking a contradiction, assume that A cannot be covered by any finite number 
of globes of that radius. 

Then if 7; € A, the globe G,, (€) does not cover A, so there is a point xz € A 
such that 


x2 ¢ Ga, er LG: p(x1, £2) 2S: 


By our assumption, A is not even covered by G,,(¢) UGz,(¢). Thus there is a 
point 73 € A with 


x3 ¢ Gz, (e) and x3 ¢ Gz, (€), ie., p(v3, 21) > € and p(x3, v2) > e 


Again, A is not covered by Les G,,(€), so there is a point x4 € A not in that 
union; its distances from x1, %2, and x3 must therefore be > e. 

Since A is never covered by any finite number of ¢-globes, we can continue 
this process indefinitely (by induction) and thus select an infinite sequence 
{@m} C A, with all its terms at least c-apart from each other. 

Now as A is compact, this sequence must have a convergent subsequence 
{@m,,}, which is then certainly Cauchy (by Theorem 1 of Chapter 3, §17). This 
is impossible, however, since its terms are at distances > ¢ from each other, 
contrary to Definition 1 in Chapter 3, §17. This contradiction completes the 
proof. 


Note 1. We have actually proved more than was required, namely, that no 
matter how small e > 0 is, A can be covered by finitely many globes of radius 
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€ with centers in A. This property is called total boundedness (Chapter 3, §13, 
Problem 4). 


Note 2. Thus all compact sets are closed and bounded. The converse fails 
in metric spaces in general (see Problem 2 below). In E” (*and C”), however, 
the converse is likewise true, as we show next. 


Theorem 4. In E” (*and C”) a set is compact iff it is closed and bounded. 


Proof. In fact, if a set A C E” (*C”) is bounded, then by the Bolzano— 
Weierstrass theorem, each sequence {x} C A has a convergent subsequence 
Lm, — p. If A is also closed, the limit point p must belong to A itself. 

Thus each sequence {x} C A clusters at some p in A, so A is compact. 


The converse is obvious. 


Note 3. In particular, every closed globe in E” (“or C”) is compact since 
it is bounded and closed (Chapter 3, §12, Example (6)), so Theorem 4 applies. 
We conclude with an important theorem, due to G. Cantor. 


Theorem 5 (Cantor’s principle of nested closed sets). Every contracting se- 
quence of nonvoid compact sets, 


By Di DS Fp, DS, 


in a metric space (S, p) has a nonvoid intersection; i.e., some p belongs to all 
Ps 

For complete sets F,,, this holds as well, provided the diameters of the sets 
F,,, tend to 0: dF, > 0. 


Proof. We prove the theorem for complete sets first. 

As Fy, 4 0, we can pick a point x, from each F;,, to obtain a sequence 
{tm}, 2m € Fm. Since dF, — 0, it is easy to see that {tm} is a Cauchy 
sequence. (The details are left to the reader.) Moreover, 


(Vm) 2m € Fm C Fi. 


Thus {2,,,} is a Cauchy sequence in F, a complete set (by assumption). 

Therefore, by the definition of completeness (Chapter 3, §17), {x} has a 
limit p € F,. This limit remains the same if we drop a finite number of terms, 
say, the first m—1 of them. Then we are left with the sequence 2, m+, ---,; 
which, by construction, is entirely contained in F\, (why?), with the same limit 
p. Then, however, the completeness of F;,, implies that p € F,, as well. As m 
is arbitrary here, it follows that (Vm) p € Fin, ie., 


pE () F,,,, as claimed. 


m=1 


The proof for compact sets is analogous and even simpler. Here {z,,} need 
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not be a Cauchy sequence. Instead, using the compactness of F, we select 
from {%,} a subsequence 2m, — p € F, and then proceed as above. O 


Note 4. In particular, in E” we may let the sets F;, be closed intervals 
(since they are compact). Then Theorem 5 yields the principle of nested in- 
tervals: Every contracting sequence of closed intervals in E” has a nonempty 
intersection. (For an independent proof, see Problem 8 below.) 


Problems on Compact Sets 


1. Complete the missing details in the proof of Theorem 5. 


2. Verify that any infinite set in a discrete space is closed and bounded but 
not compact. 


[Hint: In such a space no sequence of distinct terms clusters.] 
3. Show that E” is not compact, in three ways: 
(i) from definitions (as in Example (a’)); 
(ii) from Theorem 4; and 


(iii) from Theorem 5, by finding in EF” a contracting sequence of infinite 
closed sets with a void intersection. For example, in E! take the 
closed sets Fim = [m, +00), m=1, 2,.... (Are they closed?) 


4. Show that E* is compact under the metric p’ defined in Problems 5 and 
6 in Chapter 3, §11. Is E! a compact set under that metric? 


[Hint: For the first part, use Theorem 2 of Chapter 2, §13, noting that G, is also a 
globe under p’. For the second, consider the sequence ry, = n.| 


5. Show that a set A C (S, p) is compact iff every infinite subset B C A 
has a cluster point p € A. 


[Hint: Select from B a sequence {am} of distinct terms. Then the cluster points of 
{@m} are also those of B. (Why?)| 


6. Prove the following. 


(i) If A and B are compact, so is AU B, and similarly for unions of 
nm sets. 


(ii) If the sets A; (i € I) are compact, so is (),-, Ai, even if I is infinite. 


i€l 
Disprove (i) for unions of infinitely many sets by a counterexample. 
[Hint: For (ii), verify first that () 


icy Ai is sequentially closed. Then use Theorem 1] 


7. Prove that if zm — p in (S, p), then the set 
[cee ee rere | 


is compact. 
[Hint: If B is finite, see Example (b). If not, use Problem 5, noting that any infinite 
subset of B defines a subsequence &m, — p, so it clusters at p.] 
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Prove, independently, the principle of nested intervals in E”, i.e., The- 
orem 5 with 


Fa = [is cm Cc EY, 


where 


iy = Oise y Dye) BH gy Sh Opie dey Dae 


[Hint: As Fm+41 C Fm, Gm+1 and bm+41 are in Fy; hence by properties of closed 
intervals, 
amk < 4m+1,k < Om4i,k < bmk; k=1, 2, 06g N. 


Fixing k, let Ay be the set of all amp, m= 1, 2,.... Show that A, is bounded above 
by each bmx, so let py = sup Ax in E!. Then 


(Vm) GQmk < De < bme. (Why?) 
Unfixing k, obtain such inequalities for k = 1, 2,..., n. Let p= (pi, ..., px). Then 
(Vm) PE [am, bm], ie., PE (Fins as required. 


Note that the theorem fails for nonclosed intervals, even in E'; e.g., take Fm = 
(0, 1/m] and show that (),, Fm = 9.] 


From Problem 8, obtain a new proof of the Bolzano—Weierstrass theo- 
rem. 
(Hint: Let {Zm} € [a, 6] C E”; put Fo = [@, b] and set 


dFo = p(a, b) =d_ (diagonal of Fo). 


Bisecting the edges of Fo, subdivide Fo into 2” intervals of diagonal d/2;? one of 
them must contain infinitely many zm. (Why?) Let Fy be one such interval; make 
it closed and subdivide it into 2” subintervals of diagonal d/2?. One of them, F2, 
contains infinitely many x2; make it closed, etc. 


Thus obtain a contracting sequence of closed intervals Fi, with 


d 
dFm =—, m=1,2,.... 
am 
From Problem 8, obtain 
co 
pe () Fn 
m=1 


Show that {%m} clusters at p.] 


Prove the Heine—Borel theorem: If a closed interval Fy C E” is covered 
by a family of open sets G; (i € I), i.e., 
io © U Gi, 
i€l 
then it can always be covered by a finite number of these G;. 


[Outline of proof: Let dFo = d. Seeking a contradiction, suppose Fo cannot be 
covered by any finite number of the G;. 


3 This is achieved by drawing n planes perpendicular to the axes (Chapter 3, §§4-6). 
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11. 


12. 


13. 


14. 


As in Problem 9, subdivide Fo into 2” intervals of diagonal d/2. At least one 
of them cannot be covered by finitely many G;. (Why?) Choose one such interval, 
make it closed, call it F1, and subdivide it into 2” subintervals of diagonal d/2?. 
One of these, F2, cannot be covered by finitely many G;; make it closed and repeat 
the process indefinitely. 


Thus obtain a contracting sequence of closed intervals Fy, with 


d 


= om 


dFm m= 1,2 


> > pote 


From Problem 8 (or Theorem 5), get p € () Fm. 
As p € Fo, p is in one of the G;; call it G. As G is open, p is its interior point, 
so let G D Ga(e). Now take m so large that d/2"" = dF < ¢. Show that then 


Thus (contrary to our choice of the Fm) Fm is covered by a single set G;. This 
contradiction completes the proof.] 


Prove that if {%m}C A C (S, p) and A is compact, then {xz} converges 
iff it has a single cluster point. 
[Hint: Proceed as in Problem 12 of Chapter 3, §16.] 


Prove that if 0 4 A C (S, p) and A is compact, there are two points 
p,q €A such that dA = p(p, q). 
[Hint: As A is bounded (Theorem 3), dA < +00. By the properties of suprema, 


il 
(Vn) (Aan, yn € A) dA-—— < plan, yn) < dA. (Explain!) 
n 


By compactness, {tn} has a subsequence xn, — p € A. For brevity, put x, = rn,, 
Y;, = Yn, Again, {y;,} has a subsequence Yi, > qé€A. Also, 


1 
dA — — < Ce View ) < dA. 
n 


m 


Passing to the limit (as m — +00), obtain 

dA < p(p, q) < dA 
by Theorem 4 in Chapter 3, §15.] 
Given nonvoid sets A, B C (S, p), define 


p(A, B) =inf{p(a, y)|2 <A, y € Bh. 


Prove that if A and B are compact and nonempty, there are p € A and 
q € B such that p(p, g) = p(A, B). Give an example to show that this 
may fail if A and B are not compact (even if they are closed in E'). 
[Hint: For the first part, proceed as in Problem 12.] 


Prove that every compact set is complete. Disprove the converse by 
examples. 
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*§7. More on Compactness 


Another useful approach to compactness is based on the notion of a covering 
of a set (already encountered in Problem 10 in §6). We say that a set F is 
covered by a family of sets G; (i € I) iff 


FOUG. 


wel 


If this is the case, {G;} is called a covering of F’. If the sets G; are open, we 
call the set family {G;} an open covering. The covering {G;;} is said to be finite 
(infinite, countable, etc.) iff the number of the sets G;; is. 

If {G;} is an open covering of F’, then each point x € F is in some G; and is 
its interior point (for G; is open), so there is a globe G(éz) C G;. In general, 
the radii €, of these globes depend on 2, i.e., are different for different points 
x € F. If, however, they can be chosen all equal to some ¢, then this ¢€ is called 
a Lebesgue number for the covering {G;} (so named after Henri Lebesgue). 
Thus ¢ is a Lebesgue number iff for every x € F’, the globe G,(€) is contained 
in some G;. We now obtain the following theorem. 


Theorem 1 (Lebesgue). Every open covering {G;} of a sequentially compact 
set F C(S, p) has at least one Lebesgue number ¢. In symbols, 


(Se>0) (Vee F) (3i) Gale) CG. (1) 


Proof. Seeking a contradiction, assume that (1) fails, i.e., its negation holds. 
As was explained in Chapter 1, 881-3, this negation is 


(Ve>0) (Az €F) (Vi) Gz.) ZG, 


(where we write x, for x since here x may depend on <). As this is supposed 
to hold for all ¢ > 0, we take successively 


Then, replacing “x,” by “x,” for convenience, we obtain 


(Vn) (At, €F) (Vi) Ge. (=) ¢ Gi. (2) 


Thus for each n, there is some x, € F' such that the globe Gz, (4) is not 
contained in any G;. We fix such an x, € F for each n, thus obtaining a 
sequence {z,} C F. As F' is compact (by assumption), this sequence clusters 
at some p € F’. 

The point p, being in Ff’, must be in some G; (call it G), together with some 
globe G(r) CG. As pis a cluster point, even the smaller globe G,(5) contains 
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infinitely many x,,. Thus we may choose n so large that + <F and zg, €G,( 5): 
For that n, Gz,,(+) C Gp(r) because 


r 


(v2 € Gz, (-)) p(x, p) < p(x, tn) + p(an,p) < ~ + , 5 - 5 =i 


As G,(r) C G (by construction), we certainly have 
1 

—)C CG. 

Gs, (=) © Gp(r) SG 


However, this is impossible since by (2) no Gz,,(+) is contained in any Gj. 
This contradiction completes the proof. UO 


Our next theorem might serve as an alternative definition of compactness. 
In fact, in topology (which studies spaces more general than metric spaces), 
this zs is the basic definition of compactness. It generalizes Problem 10 in 86. 


Theorem 2 (generalized Heine-Borel theorem). A set F' C (S, p) is compact 
iff every open covering of F has a finite subcovering. 

That is, whenever F is covered by a family of open sets G; (i € I), F can 
also be covered by a finite number of these Gj. 


Proof. Let F be sequentially compact, and let F C UG, all G; open. We 
have to show that {G;} reduces to a finite subcovering. 

By Theorem 1, {G;} has a Lebesgue number « satisfying (1). We fix this 
€ > 0. Now by Note 1 in 86, we can cover F' by a finite number of ¢-globes, 


C3 


PC\ | Gel), wae ef. 


> 
lI 


1 


Also by (1), each G,, (€) is contained in some G';; call it G;,. With the G;, so 
fixed, we have 


Cis 


PC | PGede)C| Gs. 
k=1 


> 
lI 


1 


Thus the sets G;,, constitute the desired finite subcovering, and the “only if” 
in the theorem is proved. 

Conversely, assume the condition stated in the theorem. We have to show 
that F is sequentially compact, i.e., that every sequence {xz,,} C F clusters at 
some p € F’. 

Seeking a contradiction, suppose F’ contains no cluster points of {z,,}. Then 
by definition, each point x € F is in some globe G, containing at most finitely 
many Lm. The set F is covered by these open globes, hence also by finitely 
many of them (by our assumption). Then, however, F’ contains at most finitely 
many Z, (namely, those contained in the so-selected globes), whereas the 


194 Chapter 4. Function Limits and Continuity 


sequence {2,,} C F was assumed infinite. This contradiction completes the 
proof. 


§8. Continuity on Compact Sets. Uniform Continuity 


I. Some additional important theorems apply to functions that are contin- 
uous on a compact set (see 86). 


Theorem 1. [fa function f: A > (T, p’), A C (S, p), is relatively continuous 
on a compact set B C A, then f|B] is a compact set in (T, p’'). Briefly, 


the continuous image of a compact set is compact. 


Proof. To show that f[B] is compact, we take any sequence {y,,} C f[B] and 
prove that it clusters at some q € [|B]. 

As ym € f[B], ym = f(fm) for some zm in B. We pick such an zm € B for 
each ym, thus obtaining a sequence {r,} C B with 


tt) St Se ace 
Now by the assumed compactness of B, the sequence {z,,} must cluster at 
some p € B. Thus it has a subsequence 2, — p. As p € B, the function f 
is relatively continuous at p over B (by assumption). Hence by the sequential 
criterion (§2), tm, — p implies f(t%m,) 2 f(p); ie., 
Ym, > f(p) € FB]. 


Thus q = f(p) is the desired cluster point of {ym}. 


This theorem can be used to prove the compactness of various sets. 


Examples. 

(1) A closed line segment L{a, b] in E” (*and in other normed spaces) is 

compact, for, by definition, 
Lia, 6) = {a+tad|0<t<1}, where d=b-aG. 

Thus L[a, b] is the image of the compact interval [0, 1] C E! under the 
map f: E' > E™, given by f(t) = @+ tu, which is continuous by 
Theorem 3 of §3. (Why?) 

(2) The closed solid ellipsoid in E?, 


2 2 2 
x Yy z 


is compact, being the image of a compact globe under a suitable contin- 
uous map. The details are left to the reader as an exercise. 
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Lemma 1. Every nonvoid compact set F C E! has a maximum and a mini- 
mum. 


Proof. By Theorems 2 and 3 of 86, F' is closed and bounded. Thus F' has an 
infimum and a supremum in E! (by the completeness axiom), say, p = inf F 
and g = sup F’. It remains to show that p, q € F. 

Assume the opposite, say, g ¢ F’. Then by properties of suprema, each globe 
G,(6) = (¢— 46, ¢+4) contains some « € B (specifically, g— 6 < x < q) other 
than q (for q ¢ B, while x € B). Thus 


(V5>0) FNG_,(6) 49: 


i.e., F clusters at q and hence must contain q (being closed). However, since 
q ¢ F, this is the desired contradiction, and the lemma is proved. 


The next theorem has many important applications in analysis. 
Theorem 2 (Weierstrass). 
(i) If a function f: A > (T, p’) is relatively continuous on a compact set 
BCA, then f is bounded on B; i.e., f|B] is bounded. 
(ii) If, in addition, B #4 0 and f is real (f: A + E'), then f[B] has a 
maximum and a minimum; i.e., f attains a largest and a least value at 
some points of B. 


Proof. Indeed, by Theorem 1, f[B] is compact, so it is bounded, as claimed 
in (i). 

If further B 4 @ and f is real, then f[B] is a nonvoid compact set in E', so 
by Lemma 1, it has a maximum and a minimum in E£!. Thus all is proved. 


Note 1. This and the other theorems of this section hold, in particular, if 
B is a closed interval in E” or a closed globe in E” (*or C”) (because these 
sets are compact—see the examples in §6). This may fail, however, if B is 
not compact, e.g., if B = (a,b). For a counterexample, see Problem 11 in 
Chapter 3, §13. 


Theorem 3. If a function f: A > (T, p’), A C (S, p), is relatively continuous 
on a compact set B C A and is one to one on B (i.e., when restricted to B), 
then its inverse, f—', is continuous on f[B].1 


Proof. To show that f~! is continuous at each point q € f[B], we apply the 
sequential criterion (Theorem 1 in §2). Thus we fix a sequence {y,,} C f[B], 
Ym + 7 € f[B], and prove that f~"(Yym) + f~*(q). 


1 Note that f need not be one to one on all of its domain A, only on B. Thus f~! need 
not be a mapping on f[A], but it is one on f[B]. (We use “f~!” here to denote the inverse 
of f so restricted.) 
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Let f—'(ym) = 2m and f—1(q) = p so that 
Ym = f (tm), d= f(p), and am, p € B. 
We have to show that x, — p, i.e., that 
(Ve>0) (Sk) (Vm>k) plem; pb) <e. 


Seeking a contradiction, suppose this fails, i.e., its negation holds. Then 
(see Chapter 1, 81-3) there is an ¢ > 0 such that 
(Vk) (Ame >k)  p(@m,5P) 2 &; (1) 


where we write “m,;” for “m” to stress that the m, may be different for different 
k. Thus by (1), we fix some m, for each k so that (1) holds, choosing step by 
step, 


Mk+1 > Mr, ee eee 


Then the z,,, form a subsequence of {z,,}, and the corresponding ym, = 
f(%m,) form a subsequence of {Ym}. Henceforth, for brevity, let {r,} and 
{Ym} themselves denote these two subsequences. Then as before, rz» € B, 


Ym = f(%m) € f[B], and ym > g, ¢ = f(p). Also, by (1), 
(Vin) pln) > se (ey, stands for 2, }: (2) 
Now as {2%} C B and B is compact, {%m} has a (sub)subsequence 
Lm, > p for some p’ € B. 
As f is relatively continuous on B, this implies 
f(@mi) = Ymi > F(P’)- 


However, the subsequence {y,,,, } must have the same limit as {y,}, ie., f(p). 
Thus f(p’) = f(p), whence p = p’ (for f is one to one on B), so 2m, > p! = p. 
This contradicts (2), however, and thus the proof is complete.2 0 


Examples (continued). 
(3) For a fixed n € N, define f: [0, too) + E? by 


2) =2". 


Then f is one to one (strictly increasing) and continuous (being a mono- 
mial; see §3). Thus by Theorem 3, f~! (the nth root function) is relatively 
continuous on each interval 


fla, b]] — [a”, b"), 


hence on [0, +00). 


? We call f bicontinuous if (as in our case) both f and f~! are continuous. 
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See also Example (a) in 86 and Problem 1 below. 


II. Uniform Continuity. If f is relatively continuous on B, then by 
definition, 


(Ve >0) (Vp € B) (46 >0) Wr E BNG,(9)) e(F(z), fe) <e (3) 


Here, in general, 6 depends on both € and p (see Problem 4 in §1); that is, given 
€ > 0, some values of 6 may fit a given p but fail (3) for other points. 

It may occur, however, that one and the same 6 (depending on ¢€ only) 
satisfies (3) for all p € B simultaneously, so that we have the stronger formula 


(Ve >0) (45 >0) (Vp, cE B| plz, p) <6) p'(f(z), f(p))<e% (4) 


Definition 1. 


If (4) is true, we say that f is uniformly continuous on B. 


Clearly, this implies (3), but the converse fails.4 


Theorem 4. Jf a function f: A — (T, p'), A C (S, p), is relatively continuous 
on a compact set B C A, then f is also uniformly continuous on B. 


Proof (by contradiction). Suppose f is relatively continuous on B, but (4) 
fails. Then there is an ¢ > 0 such that 


(Vd >0) (Ap, 2 €B) p(x, p) <4, and yet p'(f(x), f(p)) >; 


here p and x depend on 6. We fix such an ¢ and let 


0 = 1h Hy eeey Hy sees 
yop? mM’ 


Then for each 6 (i.e., each m), we get two points tm, Pm € B with 


oltm; Pm) <= (5) 
and 
pf lem) Fm) Ze m=1, Bon (6) 


Thus we obtain two sequences, {tm} and {pm}, in B. As B is compact, 
{tm} has a subsequence 2, — q (q € B). For simplicity, let it be {z,,} itself; 
thus 


Im—2>q qEbB. 


3In other words, f(x) and f(p) are e-close for any p, x € B with p(p, x) < 6. 
4 See Example (h) below. 
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Hence by (5), it easily follows that also p,, + q (because p(%m, Dm) — 0; see 


Problem 4 in Chapter 3, 817). By the assumed relative continuity of f on B, 
it follows that 


f(&m) > f(q) and f (Pm) > f(q) in (T, p’). 


This, in turn, implies that p’(f(@m), f(pm)) 3 0, which is impossible, in view 
of (6). This contradiction completes the proof. 


One type of uniformly continuous functions are so-called contraction map- 
pings. We define them in Example (a) below and hence derive a few noteworthy 
special cases. Some of them are so-called isometries (see Problems, footnote 5). 


Examples. 


(a) A function f: A > (T, p’), A C (S, p), is called a contraction map (on 
A) iff 


p(x, y) = p'(f(x), f(y)) for all a, y € A. 


Any such map is uniformly continuous on A. In fact, given ¢ > 0, we 
simply take 6 = «. Then (Vz, p € A) 


p(x, p) <6 implies p'(f(x), f(p)) < p(x, p) <d =e, 


as required in (3). 


(b) As a special case, consider the absolute value map (norm map) given by 
f() = |z| on E” (“or another normed space). 


It is uniformly continuous on E” because 


|Z] — |a|| < |Z - Hl, ie, o'(F(®, FW) < (2, dD), 


which shows that f is a contraction map, so Example (a) applies. 
(c) Other examples of contraction maps are 
(1) constant maps (see §1, Example (a)) and 
(2) projection maps (see the proof of Theorem 3 in §3). 
Verify! 
(d) Define f: E1 > E? by 


f(z) =sine 
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By elementary trigonometry, |sinz| < |z|. Thus (Vz, p € E?) 
|f() — f(p)| = | sina — sin p| 
1 1 
=) sin 5(@ — p)-cos 5 (2 +p) 


_ 1 
oe) sin 5( ~ p) 


= |e — p| = |x — pI 
-—- 1X — = 1% — F 
5) D D 


and f is a contraction map again. Hence the sine function is uniformly 
continuous on E!'; similarly for the cosine function. 


(ec) Given 0 4 A C (S, p), define f: S — E! by 
f(x) = p(x, A) where p(x, A) = inf p(z, y). 
yEA 


It is easy to show that 


(Va,peS) p(x, A) < p(x, p)+plp, A), 
F(a) < pp, #) + F(0), or Fle) — F®) < plo, 2). 
Similarly, f(p) — f(x) < p(p, x). Thus 


f(x) — F(p)| S pp, &); 
i.e., f is uniformly continuous (being a contraction map). 
(f) The identity map f: (S, p) > (S, p), given by 
f(a) = 


is uniformly continuous on S since 


p(f(x), f(p)) = p(2, p) (a contraction map!). 


However, even relative continuity could fail if the metric in the domain 
space S' were not the same as in S when regarded as the range space 
(e.g., make p’ discrete!) 


(g) Define f: E' > E+ by 
f(z)=a+br (b#0). 
Then 
(Va,peE') |f(x)— f()| = lbl le — pl; 


i.e., 


e( f(x), f(p)) = |0| p(2, p). 
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Thus, given ¢ > 0, take 6 = €/|b|. Then 
p(x, p) <6 => p(f(z), f(p)) = |2| e(@, p) < |b]d =e, 

proving uniform continuity. 

(h) Let 
a= - on B = (0, +00). 

Then f is continuous on B, but not uniformly so. Indeed, we can prove 
the negation of (4), i-e., 
€>0) (V6 >0) (dx,peEB) plx,p)<dand p'(f(z), f(p))22. (4) 
Take « = 1 and any 6 > 0. We look for x, p such that 


jz — p| <6 and | f(x) — f(p)| > €, 


— 
u 


i.e., 
i sd 
pHs 
cp 
This is achieved by taking 
1 
p= min (6, 5) c= (Verify!) 


Thus (4) fails on B = (0, +00), yet it holds on [a, +00) for any a > 0. 
(Verify!) 


Problems on Uniform Continuity; 
Continuity on Compact Sets 


1. Prove that if f is relatively continuous on each compact subset of D, 
then it is relatively continuous on D. 
[Hint: Use Theorem 1 of §2 and Problem 7 in 86.] 


2. Do Problem 4 in Chapter 3, 817, and thus complete the last details in 
the proof of Theorem 4. 

3. Give an example of a continuous one-to-one map f such that f~! is not 
continuous. 


[Hint: Show that any map is continuous on a discrete space (S, p).] 


4. Give an example of a continuous function f and a compact set D C 
(T, p’) such that f~1[D] is not compact. 
[Hint: Let f be constant on E},] 

5. Complete the missing details in Examples (1) and (2) and (c)-(h). 


6. Show that every polynomial of degree one on E” (*or C™) is uniformly 
continuous. 
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ts 


=>8. 


10. 


11. 


12. 


Show that the arcsine function is uniformly continuous on [—1, 1]. 
[Hint: Use Example (d) and Theorems 3 and 4.] 


Prove that if f is uniformly continuous on B, and if {zm} C B is 
a Cauchy sequence, so is {f(a@m)}. (Briefly, f preserves Cauchy se- 
quences.) Show that this may fail if f is only continuous in the ordinary 
sense. (See Example (h).) 


. Prove that if f: S — T is uniformly continuous on B C S,andg: T >~ U 


is uniformly continuous on f{B], then the composite function go f is 
uniformly continuous on B. 


Show that the functions f and f~! in Problem 5 of Chapter 3, §11 are 
contraction maps, hence uniformly continuous. By Theorem 1, find 
again that (E*, p’) is compact. 


Let A’ be the set of all cluster points of A C (S, p). Let f: A > (T, p’) 
be uniformly continuous on A, and let (T, p’) be complete. 
(i) Prove that limz-,, f(a”) exists at each p € A’. 
(ii) Thus define f(p) = limz_,, f(x) for each p € A’ — A, and show 
that f so extended is uniformly continuous on the set A = AU A’.® 
(iii) Consider, in particular, the case A = (a, b) C E?, so that 
A=A = |a;.6). 


[Hint: Take any sequence {@m} C A, tm — p € A’. As it is Cauchy (why?), so is 
{f(am)} by Problem 8. Use Corollary 1 in §2 to prove existence of limz+p f(x). 
For uniform continuity, use definitions; in case (iii), use Theorem 4.] 


Prove that if two functions f, g with values in a normed vector space 
are uniformly continuous on a set B, so also are f +g and af for a fixed 
scalar a. 

For real functions, prove this also for f V g and f A g defined by 


(f V g)(x) = max(f(z), 9(2)) 
and 


(f A g)(x) = min(f(x), g()). 


[Hint: After proving the first statements, verify that 
1 . 1 
max(a, b) = 5 (@ +b6+ |b—al|) and min(a, b) = 5 (@ + b—|b—al) 


and use Problem 9 and Example (b).] 


° They even are so-called isometries; a map f: (S, p) — (T, p’) is an isometry iff for all x 


and y in S, p(x, y) = p’ (f(x), fly)). 


8 Tt is an easier problem to prove ordinary continuity. Do that first. 
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14. 


15. 


16. 


17. 
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Let f be vector valued and h scalar valued, with both uniformly contin- 
uous on B C (5S, p). 
Prove that 
(i) if f and h are bounded on B, then hf is uniformly continuous on 
B; 
(ii) the function f/h is uniformly continuous on B if f is bounded on 
B and h is “bounded away” from 0 on B, i.e., 


45>0) (Vee B) |A(x)|> 6. 


— 
u 


Give examples to show that without these additional conditions, hf and 
f/h may not be uniformly continuous (see Problem 14 below). 


In the following cases, show that f is uniformly continuous on B C E!, 
but only continuous (in the ordinary sense) on D, as indicated, with 
O0<a<b<4+om. 


(a) f(z) = 3 B= [a, +00); D = (0, 2). 


) 
(b) f(z) = a7; B= |a, 6]; D = [a, +00). 
(ce) f(z) = sin =: B and D as in (a). 
(d) f(z) = cose; B and D as in (b). 


Prove that if f is uniformly continuous on B, it is so on each subset 
ACB. 


For nonvoid sets A, B C (S, p), define 
p(A, B) = inf{p(a, y)|2 <A, y € B}. 


Prove that if p(A, B) > 0 and if f is uniformly continuous on each of A 
and B, it issoon AUB. 

Show by an example that this fails if p(A, B) = 0, even if ANB=0 
(e.g., take A = (0, 1], B = (1, 2] in £1, making f constant on each of A 
and B). 

Note, however, that if A and B are compact, AN B = @ implies 
p(A, B) > 0. (Prove it using Problem 13 in §6.) Thus AN B = 
suffices in this case. 


Prove that if f is relatively continuous on each of the disjoint closed sets 
Pia Fo, sate Eng 


it is relatively continuous on their union 


F= U Fy; 
k=1 
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hence (see Problem 6 of §6) it is uniformly continuous on F if the Fy 
are compact. 
[Hint: Fix any p € F. Then p is in some Fx, say, p € F,. As the Fy, are disjoint, 


p ¢ F2,..., Fp; hence p also is no cluster point of any of Fo, ..., Fn (for they are 
closed). 
Deduce that there is a globe Gp(6) disjoint from each of Fo, ..., Fn, so that 


FMG)(6) = FiNG),(6). From this it is easy to show that relative continuity of f 
on F follows from relative continuity on F'.] 


=>18. Let po, P1, .--, Dm be fixed points in E” (*or in another normed space). 
Let 


f(t) = De + (¢ — k) (Pe41 — Dr) 
whenever k <t<k+1,t¢€ E1,k=0,1,...,m-—1. 
Show that this defines a uniformly continuous mapping f of the in- 
terval [0, m] C E! onto the “polygon” 


m—-1 


LU Lpe, peal. 
k=0 


In what case is f one to one? Is f~! uniformly continuous on each 
L|pe, Pr+il? On the entire polygon? 

[Hint: First prove ordinary continuity on [0, m] using Theorem 1 of §3. (For the 
points 1, 2,..., m—1, consider left and right limits.) Then use Theorems 1-4.] 


19. Prove the sequential criterion for uniform continuity: A function 
f: A — T is uniformly continuous on a set B C A iff for any two 
(not necessarily convergent) sequences {z,,} and {y,} in B, with 
P(Lm; Ym) — 0, we have p'(f(am), f(ym)) > O (ie., f preserves con- 
current pairs of sequences; see Problem 4 in Chapter 3, §17). 


89. The Intermediate Value Property 


Definition 1. 


A function f: A > E* is said to have the intermediate value property, 
or Darboux property, on a set B C A iff, together with any two function 
values f(p) and f(p1) (p, pr € B), it also takes all intermediate values 
between f(p) and f(p,) at some points of B. 


In other words, the image set f[B] contains the entire interval between 
f(p) and f(pi) in E*. 


1 This property is named after Jean Gaston Darboux, who investigated it for derivatives 
(see Chapter 5, §2, Theorem 4). 
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Note 1. It follows that f[B] itself is a finite or infinite interval in E*, with 
endpoints inf f[B] and sup f[B]. (Verify!) 

Geometrically, if A C E', this means that the curve y = f(z) meets all 
horizontal lines y = q, for q between f(p) and f(p1). For example, in Figure 13 
in $1, we have a “smooth” curve that cuts each horizontal line y = q between 
f(0) and f(p1); so f has the Darboux property on [0, p;]. In Figures 14 and 
15, there is a “gap” at p; the property fails. In Example (f) of §1, the property 
holds on all of E! despite a discontinuity at 0. Thus it does not imply continuity. 

Intuitively, it seems plausible that a “continuous curve” must cut all inter- 
mediate horizontals. A precise proof for functions continuous on an interval, 
was given independently by Bolzano and Weierstrass (the same as in Theorem 2 
of Chapter 3, §16). Below we give a more general version of Bolzano’s proof 
based on the notion of a convex set and related concepts. 


Definition 2. 


A set B in £” (“or in another normed space) is said to be convex iff for 
each a, b € B the line segment L{a, 6] is a subset of B. 


A polygon joining @ and b is any finite union of line segments (a “broken 
line”) of the form 


m-1 

U Lip;, Pi41] with po = @ and pm = b. 

i=0 
The set B is said to be polygon connected (or piecewise convex) iff any two 
points a, b € B can be joined by a polygon contained in B. 


FIGURE 19 FIGURE 20 


Example. 


Any globe in E” (*or in another normed space) is convex, so also is any 
interval in E” or in E*. Figures 19 and 20 represent a convex set A and 
a polygon-connected set B in E? (B is not convex; it has a “cavity”). 


We shall need a simple lemma that is noteworthy in its own right as well. 


89. The Intermediate Value Property 205 


Lemma 1 (principle of nested line segments). Every contracting sequence of 
closed line segments L\pm, Gm] in E” (“or in any other normed space) has a 
nonvoid intersection; i.e., there is a point 

DE () Lim: Iml- 


m=1 


Proof. Use Cantor’s theorem (Theorem 5 of 86) and Example (1) in §8. O 
We are now ready for Bolzano’s theorem. The proof to be used is typical of 
so-called “bisection proofs.” (See also §6, Problems 9 and 10 for such proofs.) 


Theorem 1. Jf f: B > E' is relatively continuous on a polygon-connected 
set B in E” (*or in another normed space), then f has the Darboux property 
on B. 


In particular, if B is convex and if f(p) <c< f(q) for some p, g € B, then 
there is a point 7 € L(p, q) such that f(r) =c. 


Proof. First, let B be convex. Seeking a contradiction, suppose p, g € B with 
fp) <e< f(Q); 


yet f(z) Ac for all z € L(p, q). 
Let P be the set of all those z € Lp, q] for which f(Z) < ¢, ie., 


P= {£ € Lip, q)| f(®) < ¢}, 


and let 


Q= {£ € Lp, q] | f(®) > ch. 


Then pe P, GE Q, PNQ =H, and PUQ = Lip, g C B. (Why?) 
Now let 


be the midpoint on Lp, qg]. Clearly, 79 is either in P or in Q. Thus it bisects 
L|p, q| into two subsegments, one of which must have its left endpoint in P and 
its right endpoint in Q.? 

We denote this particular closed segment by L[p1, Gi], pi € P, GH € Q. We 
then have 


Mi, . 
L[pi, %] S Lip, q| and |pi — m| = lg — q|. (Verify!) 


Now we bisect L[pi, G1] and repeat the process. Thus let 


1 
rT, = 3 (Pt + q). 


? Indeed, if 79 € P, this holds for L[7o, gj. If 7) € Q, take Lp, Fo]. 
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By the same argument, we obtain a closed subsegment L|p2, ga] C Lipi, Hi], 
with po € P, G2 € Q, and 

I — @| = Sl — l= 51-4 

p2— q2 — 5/P1 q1 = WIP q|- 


Next, we bisect L[p2, G2], and so on. Continuing this process indefinitely, we 
obtain an infinite contracting sequence of closed line segments L[fm, Gm] such 
that 


(Vm) DPmeéP, Gn © Q, 
and 


1 


By Lemma 1, there is a point 


This implies that 


(Vm) r= Dias | — lPm = yn = i, 


whence p, > 7. Similarly, we obtain G, — 7. 
Now since 7 € Lp, q| C B, the function f is relatively continuous at 7 over 
B (by assumption). By the sequential criterion, then, 


f (Pm) + f(r) and f(Gm) > F(7). 


Moreover, f(fm) <¢< f(Gm) (for Dm € P and Gm € Q). Letting m — +c, 
we pass to limits (Chapter 3, §15, Corollary 1) and get 


iF) Ses fh), 


so that 7 is neither in P nor in Q, which is a contradiction. This completes 
the proof for a convex B. 

The extension to polygon-connected sets is left as an exercise (see Problem 
2 below). Thus all is proved. 


Note 2. In particular, the theorem applies if B is a globe or an interval. 

Thus continuity on an interval implies the Darboux property. The converse 
fails, as we have noted. However, for monotone functions, we obtain the fol- 
lowing theorem. 


Theorem 2. Jf a function f: A — E! is monotone and has the Darboux 
property on a finite or infinite interval (a,b) C A C E?, then it is continuous 
on (a, b). 


Proof. Seeking a contradiction, suppose f is discontinuous at some p € (a, 0). 
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For definiteness, let ft on (a, b). Then by Theorems 2 and 3 in 85, we 
have either f(p~) < f(p) or f(p) < f(pt) or both, with no function values in 
between. 

On the other hand, since f has the Darboux property, the function values 
f(x) for x in (a, b) fill an entire interval (see Note 1). Thus it is impossible 
for f(p) to be the only function value between f(p~) and f(pt) unless f is 
constant near p, but then it is also continuous at p, which we excluded. This 
contradiction completes the proof.® 


Note 3. The theorem holds (with a similar proof) for nonopen intervals as 
well, but the continuity at the endpoints is relative (right at a, left at b). 


Theorem 3. If f: A — E! is strictly monotone and continuous when re- 
stricted to a finite or infinite interval B C A C E', then its inverse f—' has 
the same properties on the set f|B] (itself an interval, by Note 1 and Theo- 
rem 1).4 


Proof. It is easy to see that f~! is increasing (decreasing) if f is; the proof is 
left as an exercise. Thus f~! is monotone on f[B] if f is so on B. To prove 
the relative continuity of f—', we use Theorem 2, i.e., show that f~1 has the 
Darboux property on f[B]. 

Thus let f~1(p) < ¢ < f7'(q) for some p, q € f[B]. We look for an r € f[B] 
such that f~!(r) =c, ie., r = f(c). Now since p, q € f[B], the numbers f~1(p) 
and f~'(q) are in B, an interval. Hence also the intermediate value c is in B; 
thus it belongs to the domain of f, and so the function value f(c) exists. It 
thus suffices to put r = f(c) to get the result. 


Examples. 
(a) Define f: E' + E' by 


f(x) =x” for a fixed n € N. 


As f is continuous (being a monomial), it has the Darboux property 
on E'. By Note 1, setting B = [0, +00), we have f[B] = [0, +00). 
(Why?) Also, f is strictly increasing on B. Thus by Theorem 3, the 
inverse function f—' (i.e., the nth root function) exists and is continuous 
on f[B] = [0, +00). 

If n is odd, then f~! has these properties on all of E!, by a similar 
proof; thus %/z exists for x € E?. 


(b) Logarithmic functions. From the example in §5, we recall that the expo- 


3 More formally, if, say, f(p) < f(pt), let f(p) <c < f(pt) < f(p’), p’ € (p, b). (Such a 
p’ exists since ft, and f(pt) = inf{f(ax) | p < x < b}; see §5, Theorem 1.) By the Darboux 
property, f(x) = c for some z € (a, b), but this contradicts Theorem 2 in §5. 

4 We write “f” for “f restricted to B” as well; cf. also footnote 1 in §8. 
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nential function given by 
Figj=a" (a>0) 


is continuous and strictly monotone on £!.° Its inverse, F—!, is called 
the logarithmic function to the base a, denoted log,. By Theorem 3, it is 
continuous and strictly monotone on F|E'}. 

To fix ideas, let a > 1, so Ft and (F~*)+t. By Note 1, F[E*] is an 
interval with endpoints p and r, where 


p = inf F[E"] = inf{a® | —oo < x < +00} 


and 
r = sup F[E') = sup{a® | —oo < x < +oo}. 


Now by Problem 14(iii) of §2 (with ¢ = 0), 


lim a*=+ooand lim a’*=0. 
«r—> +00 ~—>—00 


As Ft, we use Theorem 1 in §5 to obtain 


r=supa”* = lim a® =+oo andp= lim a* =0. 
®r—+00 L—->—0o 

Thus F[E"], i-e., the domain of log,, is the interval (p, r) = (0, +00). It 
follows that log, x is uniquely defined for x in (0, +00); it is called the 
logarithm of x to the base a. 

The range of log, (i.e. of F~') is the same as the domain of F, i.e., E*. 
Thus if a > 1, log, x increases from —oo to +00 as z increases from 0 to 
+oo. Hence 


lim log,x =-+00 and lim log, x = —ov, 
t—>+00 x—0O+ 


provided a > 1. 

If 0 < a < 1, the values of these limits are interchanged (since F’| in 
this case), but otherwise the results are the same. 

If a = e, we write Inz or log for log, x, and we call Inz the natural 
logarithm of x. Its inverse is, of course, the exponential f(x) = e”, also 
written exp(x). Thus by definition, Ine” = x and 


xz =exp(Inz)=e™* (0< a2 < +00). (1) 


(c) The power function g: (0, +oo) + E' is defined by 


g(x) = x for a fixed real a. 


5 We exclude the case a = 1 here. 
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If a > 0, we also define g(0) = 0. For x > 0, we have 


x* = exp(Inz*) = exp(a-Inz). 


Thus by the rules for composite functions (Theorem 3 and Corollary 2 in 
§2), the continuity of g on (0, +00) follows from that of exponential and 
log functions. If a > 0, g is also continuous at 0. (Exercise!) 


Problems on the Darboux Property and Related Topics 
1. Prove Note 1. 

1’. Prove Note 3. 

1”. Prove continuity at 0 in Example (c). 


2. Prove Theorem 1 for polygon-connected sets. 


[Hint: If 
m1 
BD VU Lippi, pis] 
i=0 
with 


f(Po) <c< f(Pm), 


show that for at least one i, either c = f(p;) or f(pi) <c < f(pi4i). Then replace 
B in the theorem by the convex segment L/p;, pi+1].] 

3. Show that, if f is strictly increasing on B C E, then f—! has the same 
property on f[B], and both are one to one; similarly for decreasing 
functions. 


4. For functions on B = [a, b] C E', Theorem 1 can be proved thusly: If 


fla) <e< f(b), 


let 
P=1@e 8 | fla) < 6} 


and put r = sup P. 

Show that f(r) is neither greater nor less than c, and so necessarily 
f(r) =e. 
[Hint: If f(r) < c, continuity at r implies that f(x) < c on some G,(6) (§2, 
Problem 7), contrary to r = sup P. (Why’)| 


5. Continuing Problem 4, prove Theorem 1 in all generality, as follows. 
Define 
g(t) =p+t(¢—p), O<t<1. 
Then g is continuous (by Theorem 3 in §3), and so is the composite 
function h = f og, on [0, 1]. By Problem 4, with B = (0, 1], there is a 
t € (0, 1) with h(t) =c. Put r = g(t), and show that f(r) =c. 
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6. Show that every equation of odd degree, of the form 
fa= > age” =0 (n=2m-1), 
k=0 


has at least one solution for x in E!. 


[Hint: Show that f takes both negative and positive values as x + —oo or x > +00; 
thus by the Darboux property, f must also take the intermediate value 0 for some 
zé | 


7. Prove that if the functions f: A > (0, +00) and g: A > E! are both 
continuous, so also is the function h: A > E! given by 


h(x) = f(x). 


[Hint: See Example (c)]. 


8. Using Corollary 2 in §2, and limit properties of the exponential and log 


functions, prove the “shorthand” Theorems 11-16 of 84. 

i ae 1\v* 

8’. Find lim (1+-) : 
z 


®r—+00 


8”. Similarly, find a new solution of Problem 27 in Chapter 3, §15, reducing 
it to Problem 26. 


9. Show that if f: E' + E* has the Darboux property on B (e.g., if B is 
convex and f is relatively continuous on B) and if f is one to one on B, 
then f is necessarily strictly monotone on B. 


10. Prove that if two real functions f, g are relatively continuous on |a, | 
(a < b) and 


f(x)g(x) > 0 for x € [a, 5], 
then the equation 
(x — a) f(x) + (w— b)g(x) = 0 
has a solution between a and 0b; similarly for the equation 


10’. Similarly, discuss the solutions of 


2 9 | 
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§10. Arcs and Curves. Connected Sets 


A deeper insight into continuity and the Darboux property can be gained by 
generalizing the notions of a convex set and polygon-connected set to obtain 
so-called connected sets. 


I. As a first step, we consider arcs and curves. 


Definition 1. 


A set A C (S, p) is called an arc iff A is a continuous image of a compact 
interval [a, b] C E’, i-e., iff there is a continuous mapping 


fe \a, b] —> A. 


If, in addition, f is one to one, A is called a simple arc with endpoints 
f(a) and f(b). 

If instead f(a) = f(b), we speak of a closed curve. 

A curve is a continuous image of any finite or infinite interval in E'. 


Corollary 1. Each arc is a compact (hence closed and bounded) set (by 
Theorem 1 of 88). 


Definition 2. 


A set A C (S, p) is said to be arcwise connected iff every two points 
p, q © A are in some simple arc contained in A. (We then also say the p 
and q can be joined by an arc in A.) 


Examples. 
(a) Every closed line segment L[a@, | in E” (*or in any other normed space) 
is a simple arc (consider the map f in Example (1) of §8). 


(b) Every polygon 


m1 
A= U L{pi, Pi+1| 
i=0 
is an arc (see Problem 18 in 88). It is a simple arc if the half-closed 
segments L|p;, pi41) do not intersect and the points p; are distinct, for 
then the map f in Problem 18 of §8 is one to one. 


(c) It easily follows that every polygon-connected set is also arcwise con- 
nected; one only has to show that every polygon joining two points po, Dm 
can be reduced to a simple polygon (not a self-intersecting one). See 
Problem 2. 

However, the converse is false. For example, two discs in E? connected 
by a parabolic arc form together an arcwise- (but not polygonwise-) con- 
nected set. 
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(d) Let f1, fo, .--, fn be real continuous functions on an interval J C £}. 
Treat them as components of a function f: I > E”, 
f= (fi, ace! 89 In) 


Then f is continuous by Theorem 2 in §3. Thus the image set f[J] is a 
curve in E”; it is an arc if I is a closed interval. 
Introducing a parameter t varying over J, we obtain the parametric 
equations of the curve, namely, 
= Jet) Fe Ne De weg We 


Then as t varies over I, the point Z = (x1, ..., &,) describes the curve 
f [J]. This is the usual way of treating curves in £” (*and C”). 


It is not hard to show that Theorem 1 in 89 holds also if B is only arcwise 
connected (see Problem 3 below). However, much more can be proved by 
introducing the general notion of a connected set. We do this next. 


*II. For this topic, we shall need Theorems 2—4 of Chapter 3, 812, and 
Problem 15 of Chapter 4, 82. The reader is advised to review them. In partic- 
ular, we have the following theorem. 


Theorem 1. A function f: (A, p) > (T, p’) is continuous on A iff f~*[B] is 
closed in (A, p) for each closed set B C (T, p’); similarly for open sets. 

Indeed, this is part of Problem 15 in §2 with (S, p) replaced by (A, p). 
Definition 3. 


A metric space (S, ) is said to be connected iff S is not the union PUQ 
of any two nonvoid disjoint closed sets; it is disconnected otherwise. 

A set A C (S, p) is called connected iff (A, ) is connected as a subspace 
of (S, p); ie., iff A is not a union of two disjoint sets P,Q 4 @ that are 
closed (hence also open) in (A, p), as a subspace of (S, p). 


Note 1. By Theorem 4 of Chapter 3, §12, this means that 
P=ANP, andQ=ANQ, 
for some sets P,, Q; that are closed in (5, ). Observe that, unlike compact 
sets, a set that is closed or open in (A, p) need not be closed or open in (S, p). 
Examples. 
(a’) @ is connected. 

(b’) So is any one-point set {p}. (Why?) 

1 The term “closed” may be replaced by “open” here, for P and Q are open as well, each 


being the complement of the other closed set. Similarly, if they are open, they are both open 
and closed (briefly, “clopen”). 


§10. Arcs and Curves. Connected Sets 213 
(c’) Any finite set of two or more points is disconnected. (Why?) 


Other examples are provided by the theorems that follow. 


Theorem 2. The only connected sets in E! are exactly all convex sets, i.e., fi- 
nite and infinite intervals, including E' itself. 


Proof. The proof that such intervals are exactly all convex sets in E! is left 
as an exercise. 

We now show that each connected set A C E! is convex, i.e., that a, b € A 
implies (a, b) C A. 

Seeking a contradiction, suppose p ¢ A for some p € (a, b), a, b € A. Let 


P= AN (oo, p) and Q = AN (p, +00). 


Then A = PUQ,a€ P,b€ Q, and PNQ = 9. Moreover, (—oo, p) and 
(p, +00) are open sets in E'. (Why?) Hence P and Q are open in A, each 
being the intersection of A with a set open in E! (see Note 1 above). As 
A= PUQ, with PNQ = 9, it follows that A is disconnected. This shows that 
if A is connected in E', it must be convex. 

Conversely, let A be convex in E!. The proof that A is connected is an 
almost exact copy of the proof given for Theorem 1 of 89, so we only briefly 
sketch it here.” 

If A were disconnected, then A = PU Q for some disjoint sets P,Q 4 0, 
both closed in A. Fix any p € P and q € Q. Exactly as in Theorem 1 of §9, 
select a contracting sequence of line segments (intervals) [pm, dm] CG A such 
that Dm € P, dm € Q, and |pm — dm| — 0, and obtain a point 


r€ () Pm: dm] CA, 


m=1 


so that pm > T, dm > T, and r € A. As the sets P and Q are closed in 
(A, p), Theorem 4 of Chapter 3, §16 shows that both P and Q must contain the 
common limit r of the sequences {p,,} C P and {qm} C Q. This is impossible, 
however, since PQ = @, by assumption. This contradiction shows that A 
cannot be disconnected. Thus all is proved. 


Note 2. By the same proof, any convex set in a normed space is connected. 
In particular, E” and all other normed spaces are connected themselves.? 


Theorem 3. Jf a function f: A > (T, p’) with A C (S, p) is relatively con- 
tinuous on a connected set B C A, then f[B] is a connected set in (T, p').* 


? Note that the same proof holds also for A in any normed space. 
3 See also Corollary 3 below (note that it presupposes Corollary 2, hence Theorem 2). 
4 Briefly, any continuous image of a connected set is connected itself. 
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Proof. By definition (§1), relative continuity on B becomes ordinary continu- 
ity when f is restricted to B. Thus we may treat f as a mapping of B into 
f[B], replacing S and T by their subspaces B and f[B}. 


Seeking a contradiction, suppose f|B] is disconnected, i-e., 
f|B] = PUQ 


for some disjoint sets P, Q 4 @ closed in (f[B], p’). Then by Theorem 1, with 
T replaced by f[B], the sets f~*[P] and f~+[Q] are closed in (B, p). They also 
are nonvoid and disjoint (as are P and Q) and satisfy 


ps f  |Pud| = f-'[P] U f*[Q] 


(see Chapter 1, 84-7, Problem 6). Thus B is disconnected, contrary to as- 
sumption. LL 


Corollary 2. All arcs and curves are connected sets (by Definition 2 and 
Theorems 2 and 3). 


Lemma 1. A set A C (S, p) is connected iff any two points p,q € A are in 
some connected subset B C A. Hence any arcwise connected set is connected. 


Proof. Seeking a contradiction, suppose the condition stated in Lemma 1 
holds but A is disconnected, so A = PUQ for some disjoint sets P 4 0, Q 4 0, 
both closed in (A, p). 


Pick any p € P and q € Q. By assumption, p and q are in some connected 
set B C A. Treat (B, p) as a subspace of (A, p), and let 


P=B0P and =BAd: 


Then by Theorem 4 of Chapter 3, §12, P’ and Q’ are closed in B. Also, they 
are disjoint (for P and Q are) and nonvoid (for p € P’, q € Q’), and 


B=BnA=Bi(PUO)=(BOP)U(BAe) =P uC’. 


Thus B is disconnected, contrary to assumption. This contradiction proves the 
lemma (the converse proof is trivial). 

In particular, if A is arcwise connected, then any points p,q in A are in 
some arc B C A, a connected set by Corollary 2. Thus all is proved. 


Corollary 3. Any convex or polygon-connected set (e.g., a globe) in E” (or 
in any other normed space) is arcwise connected, hence connected. 


Proof. Use Lemma 1 and Example (c) in part I of this section. O 


Caution: The converse fails. A connected set need not be arcwise connected, 
let alone polygon connected (see Problem 17). However, we have the following 
theorem. 


§10. Arcs and Curves. Connected Sets 215 


Theorem 4. Every open connected set A in E” (*or in another normed space) 
is also arcwise connected and even polygon connected. 


Proof. If A= 90, this is “vacuously” true, so let A 4 @ and fix a € A. 

Let P be the set of all p € A that can be joined with @ by a polygon K C A. 
Let Q = A-—P. Clearly, @ € P, so P #4 J. We shall show that P is open, 
i.e., that each p € P is in a globe Gp C P. 

Thus we fix any p € P. As A is open and p € A, there certainly is a globe 
Gy contained in A. Moreover, as G'p is convex, each point Z € Gp is joined 
with p by the line segment L[Z, p] C Gp. Also, as p € P, some polygon K C A 
joins p with a. Then 

KULz, pl 


is a polygon joining @ and a, and hence by definition  € P. Thus each z € Gp 
is in P, so that G5 C P, as required, and P is open (also open in A as a 
subspace). 

Next, we show that the set Q = A — P is open as well. As before, if Q 4 0, 
fix any g € Q and a globe Gg C A, and show that Gz C Q. Indeed, if some 
Z € Gg were not in Q, it would be in P, and thus it would be joined with a 
(fixed above) by a polygon K C A. Then, however, q itself could be so joined 
by the polygon 

Liq, z] UK, 
implying that ¢ €¢ P, not ¢g € Q. This shows that Gz C @ indeed, as claimed. 

Thus A = PUQ with P, Q disjoint and open (hence clopen) in A. The 

connectedness of A then implies that Q = @. (P is not empty, as has been 


noted.) Hence A = P. By the definition of P, then, each point b € A can be 
joined to a by a polygon. As a € A was arbitrary, A is polygon connected. 


Finally, we obtain a stronger version of the intermediate value theorem. 


Theorem 5. If a function f: A— E' is relatively continuous on a connected 
set BC AC(S, p), then f has the Darboux property on B. 


In fact, by Theorems 3 and 2, f[B] is a connected set in E', i.e., an interval. 
This, however, implies the Darboux property. 


Problems on Arcs, Curves, and Connected Sets 


1. Discuss Examples (a) and (b) in detail. In particular, verify that L[a, 0] 
is a simple arc. (Show that the map f in Example (1) of §8 is one to 
one.) 

2. Show that each polygon 

m-1 
k= U L[pi, Pi+1] 
i=0 
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can be reduced to a simple polygon P (P C K) joining po and p,»». 
[Hint: First, show that if two line segments have two or more common points, they 
lie in one line. Then use induction on the number m of segments in K. Draw a 
diagram in E? as a guide.] 


. Prove Theorem 1 of §9 for an arcwise connected B C (S, p). 


[Hint: Proceed as in Problems 4 and 5 in §9, replacing g by some continuous map 
f: [a, sae B,] 
onto 


. Define f as in Example (f) of §1. Let 


Gab = {(2, y) € EF’ |a<a<b, y= f(a}. 
(Gap is the graph of f over [a, b|.) Prove the following: 
(i) If a > 0, then Gy is a simple arc in E?. 
(ii) If a<0 <b, Gop is not even arcwise connected. 


[Hints: (i) Prove that f is continuous on [a, b], a > 0, using the continuity of the 
sine function. Then use Problem 16 in 82, restricting f to [a, 6]. 


(ii) For a contradiction, assume 0 is joined by a simple arc to some p € Gap_] 


. Show that each arc is a continuous image of {0, 1]. 


(Hint: First, show that any [a,b] C E! is such an image. Then use a suitable 
composite mapping. | 


Prove that a function f: B — E' on a compact set B C E! must be 
continuous if its graph, 


{(a,y) € E* | xe B, y= f(x}, 


is a compact set (e.g., an arc) in E?. 
[Hint: Proceed as in the proof of Theorem 3 of §8.] 


Prove that A is connected iff there is no continuous map 
f:A— {0, 1}.° 
onto 


[Hint: If there is such a map, Theorem 1 shows that A is disconnected. (Why?) 
Conversely, if A= PUQ (P, @ as in Definition 3), put f =0 on Pand f=1onQ. 
Use again Theorem 1 to show that f so defined is continuous on A.] 


Let BC A C (S, p). Prove that B is connected in S iff it is connected 
in (A, p). 


Suppose that no two of the sets A; (7 € J) are disjoint. Prove that if all 
A; are connected, so is A = Uj. Aj. 

[Hint: If not, let A = PUQ (P,Q as in Definition 3). Let P; = A; MP and 
Qi; = Ai NQ,so Aj = P,UQ:,71€ I. 


> That is, onto a two-point set {O} U {1}. 
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At least one of the P;, Q; must be 0 (why?); say, Q; = @ for some j € I. Then 
(Vi) Q; =, for Q; 49 implies P; = 0, whence 


Ay = Qi © QO = A, NA; = 0 (Bince A; € P), 
contrary to our assumption. Deduce that Q = U,; Q; = 0. (Contradiction!)] 


Prove that if {A,} is a finite or infinite sequence of connected sets and 
if 


(Vn) An MN An+1 oa 0, 


A=(J4, 


then 


is connected. 

[Hint: Let Bn = Up, Ax. Use Problem 9 and induction to show that the Bn are 
connected and no two are disjoint. Verify that A =U,, Bn and apply Problem 9 to 
the sets By.] 


Given p € A, A C (S, p), let Ap denote the union of all connected subsets 
of A that contain p (one of them is {p}); Ap is called the p-component 
of A. Prove that 


(i) Ap is connected (use Problem 9); 

(ii) A, is not contained in any other connected set B C A with p € B; 
(iii) (Vp, qe€ A) ApN A, = @ iff A, # Ag; and 

(iv) A=Uf4p | p € A}. 
[Hint for (iii): If Ap NM Ag 4 O and Ap # Ag, then B = Ap U Ag is a connected set 
larger than Ap, contrary to (ii).] 
Prove that if A is connected, so is its closure (Chapter 3, 816, 
Definition 1), and so is any set D such that AC DCA. 
[Hints: First show that D is the “least” closed set in (D, p) that contains A 


(Problem 11 in Chapter 3, §16 and Theorem 4 of Chapter 3, §12). Next, seeking 
a contradiction, let D= PUQ, PNQ=9%, P, Q 49, clopen in D. Then 


A=(ANP)U(ANQ) 


proves A disconnected, for if AN P = @, say, then A C Q C D (why?), contrary to 
the minimality of D; similarly for AN Q = 9.] 


A set is said to be totally disconnected iff its only connected subsets are 
one-point sets and 0. 
Show that R (the rationals) has this property in E?. 


Show that any discrete space is totally disconnected (see Problem 13). 


From Problems 11 and 12 deduce that each component A, is closed 
(Ap — Ap). 
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*16. Prove that a set A C (S, p) is disconnected iff A = PUQ, with P, Q 4 9, 
and each of P, Q disjoint from the closure of the other: PA Q = @ = 
PQ. 

[Hint: By Problem 12, the closure of P in (A, p) (i.e., the least closed set in (A, p) 
that contains P) is 


ANP =(PUQNP=(PnPuenr)]=Lfut=eFr 
so P is closed in A; similarly for Q. Prove the converse in the same manner.] 


*17. Give an example of a connected set that is not arcwise connected. 


[Hint: The set Go, (a = 0) in Problem 4 is the closure of Go, — {0} (verify!), and 
the latter is connected (why?); hence so is Gog by Problem 12.] 
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Given two metric spaces (X, p,) and (Y, p2), we may consider the Cartesian 
product X x Y, suitably metrized. Two metrics for X x Y are suggested in 
Problem 10 in Chapter 3, 811. We shall adopt the first of them as follows. 


Definition 1. 


By the product of two metric spaces (X, p,) and (Y, p2) is meant the 
space (X x Y, p), where the metric p is defined by 


p((x, y), (2, y')) = max{pr(a, 2”), paly, y')} (1) 
for x, 7’ € X andy, y’ EY. 
Thus the distance between (x, y) and (x’, y’) is the larger of the two distances 
pi(x, x’) in X and pa(y, y’) inY. 


The verification that p in (1) is, indeed, a metric is left to the reader. We now 
obtain the following theorem. 


Theorem 1. 


(i) A globe Gi, q)(€) in (X XY, p) is the Cartesian product of the correspond- 
ing €-globes in X and Y, 


Gp, q)(€) = Gpl€) x Gale). 


(ii) Convergence of sequences {(%m, Ym)} in X x Y is componentwise. That 
is, we have 


(Lm; Ym) > (p,q) inX x Y ifftm— pin X and ym oq inY. 
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Again, the easy proof is left as an exercise. 

In this connection, recall that by Theorem 2 of Chapter 3, 815, convergence 
in E? is componentwise as well, even though the standard metric in E? is not 
the product metric (1); it is rather the metric (ii) of Problem 10 in Chapter 3, 
811. We might have adopted this second metric for X x Y as well. Then part 
(i) of Theorem 1 would fail, but part (ii) would still follow by making 


€ & 
m; DP) < —= and mq) <—=.- 
pPi(Zm; P) a p2(Ym, 4) Ji 


It follows that, as far as convergence is concerned, the two choices of p are 
equivalent. 


Note 1. More generally, two metrics for a space S are said to be equivalent 
iff exactly the same sequences converge (to the same limits) under both metrics. 
Then also all function limits are the same since they reduce to sequential limits, 
by Theorem 1 of §2; similarly for such notions as continuity, compactness, 
completeness, closedness, openness, etc. 

In view of this, we shall often call X x Y a product space (in the wider sense) 
even if its metric is not the p of formula (1) but equivalent to it. In this sense, 
E? is the product space E! x E!, and X x Y is its generalization. 

Various ideas valid in E? extend quite naturally to X x Y. Thus functions 
defined on a set A C X x Y may be treated as functions of two variables x, 
y such that (x, y) € A. Given (p, gq) € X x Y, we may consider ordinary or 
relative limits at (p, q), e.g., limits over a path 


B={(tz,y)EXxY |y=gh 


(briefly called the “line y = q’). In this case, y remains fixed (y = q) while 
x —> p; we then speak of limits and continuity in one variable x, as opposed to 
those in both variables jointly, i.e., the ordinary limits (cf. §3, part IV). 

Some other kinds of limits are to be defined below. For simplicity, we con- 
sider only functions f: (X x Y) > (T, p’) defined on all of X x Y. If confusion 
is unlikely, we write p for all metrics involved (such as p’ in T’). Below, p and q 
always denote cluster points of X and Y, respectively (this justifies the “lim” 
notation). Of course, our definitions apply in particular to E? as the simplest 
special case of X x Y. 


Definition 2. 


A function f: (X x Y) — (T, p’) is said to have the double limit s € T 
at (p, q), denoted 


s= lim f(z, y), 
yd 


iff for each ¢ > 0, there is a 6 > 0 such that f(x, y) € Gs(e) whenever 
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x € G_,(d) and y € G_,(6). In symbols, 
(Ve > 0) (6 >0) (Vz €Gp(6)) (Wy ECg(d)) fla, y) EG). (2) 


Observe that this is the relative limit over the path 


D = (X — {p}) x (Y — {a}) 
excluding the two “lines” x = p and y = q. If f were restricted to D, this 


would coincide with the ordinary nonrelative limit (see §1), denoted 


s= lim ©, y). 
gine ¥) 


where only the point (p, q) is excluded. Then we would have 


(Ve > 0) (4d > 0) (V(2,y) € Gawpq)(9)) fla, y) € Gs(€). (3) 


Now consider limits in one variable, say, 
lim f(x, y) with x fixed. 
yq 
If this limit exists for each choice of x from some set B C X, it defines a 


function 
g: BoT 


with value 
g(x) = lim f(z, y), @eEB. 
Yq 


This means that 


(Va € B) (Ve >0) (40> 0) (V¥E Gig(d)) plg(z), F(a, y))<e. (4) 


Here, in general, 6 depends on both « and x. However, in some cases (re- 
sembling uniform continuity), one and the same 6 (depending on < only) fits 
all choices of x from B. This suggests the following definition. 


Definition 3. 


With the previous notation, suppose 


lim f(z, y) = g(x) exists for each a € B (BCX). 
yg 


We say that this limit is uniform in x (on B), and we write 


4 


g(x) = lim f(z, y) (uniformly for x € B),” 
yg 


iff for each c > 0, there is a 6 > 0 such that p(g(x), f(x, y)) < € for all 
x € B and all y € G_,(6). In symbols, 


(Ve > 0) (46 >0) (Va eB) (Vy¥EGig(9)) plg(z), F(t, y))<e. (5) 
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Usually, the set B in formulas (4) and (5) is a deleted neighborhood of p in 
xX, €.2., 
B= Gaglf) or B= xX — ph 


Assume (4) for such a B, so 


lim f(x, y) = g(x) exists for each x € B. 
yq 


If, in addition, 


lim g(z) = s 


exists, we call s the iterated limit of f at (p, q) (first in y, then in x), denoted 


lim lim f(z, y). 


This limit is obtained by first letting y > q (with x fixed) and then letting 


x — p. Quite similarly, we define 


lim lim f(z, y). 


y>q tp 


In general, the two iterated limits (if they exist) are different, and their 
existence does not imply that of the double limit (2), let alone (3), nor does it 
imply the equality of all these limits. (See Problems 4ff below.) However, we 
have the following theorem. 


Theorem 2 (Osgood). Let (T, p’) be complete. Assume the existence of the 
following limits of the function f: X x Y > T: 


(i) lim f(x, y) = g(@) (uniformly for « € X — {p}) and 
(ii) Tim f(w, y) = h(y) for y €Y — {q}." 


Then the double limit and the two iterated limits of f at (p,q) exist and all 
three coincide. 


Proof. Let ¢ > 0. By our assumption (i), there is a 6 > 0 such that 


(Vee X — {pt) Vy € Gag(9))  plg(), Fla, y)) < ‘ (cf. (5). (5’) 


Now take any y’, y” € G_,(6). By assumption (ii), there is an 2’ € X — {p} 
so close to p that 


p(h(y'), £(e',y')) < Zand plh(y"), Fla’, y")) < 5. (Why?) 


oe) 


' Actually, it suffices to assume the existence of the limits (i) and (ii) for x in some G.p(r) 
and y in some G—,(r). Of course, it does not matter which of the two limits is uniform. 
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Hence, using (5’) and the triangle law (repeatedly), we obtain for such y’, y” 


p(h(y’), h(y”)) < platy’), F(a’, y')) + e( f(a", y’), 9(2’)) 
ee Sew ae le a), ka) 
E E E E 
< mi + ri + A + A = €, 


It follows that the function h satisfies the Cauchy criterion of Theorem 2 in 
§2. (It does apply since T is complete.) Thus lim,_,,h(y) exists, and, by 
assumption (ii), it equals lim lim f(x, y) (which therefore exists). 

yq xp 
Let then H = ba h(y). With 6 as above, fix some yo € G4,(6) so close to q 
that 


p(h(yo), H) < =. 


Also, using assumption (ii), choose a 6’ > 0 (6 < 6) such that 


p(h(yo), f(2, yo)) < - for x € Gap(6'). 
Combining with (5’), obtain (Va € G_,(0’)) 
p(H, g(x)) < p(H, h(yo)) + p(h(yo), F(x, yo)) + e( f(z, yo); g(x)) < J (6) 
Thus 
(VzeGp(5")) p(H, g(z)) <e. 


Hence lim;-,, g(a) = H, i-e., the second iterated limit, lim lim f(z, y), likewise 
exists and equals H. eas 
Finally, with the same 6’ < 6, we combine (6) and (5’) to obtain 
(Vr € Gip(6")) (Vy € Gag(5")) 
JE  € 


P(A, f(x, y)) < e(A, g(x)) + p(g(2), f(x, y)) < ata 


Hence the double limit (2) also exists and equals H. O 


Note 2. The same proof works also with f restricted to (X —{p}) x (Y—{q}) 
so that the “lines” x = p and y = q are excluded from Dy. In this case, 
formulas (2) and (3) mean the same; i.e., 

lim fia.¢) = lim fa ay) 
nee 7 9) (x, y)>(p, 4) 9) 

Note 3. In Theorem 2, we may take E* (suitably metrized) for X or Y 
or T’. Then the theorem also applies to limits at -+too, and infinite limits. We 
may also take X = Y = NU {+00} (the naturals together with +00), with the 
same E*-metric, and consider limits at p = q = +oo. Moreover, by Note 2, we 
may restrict f to N x N, so that f: N x N — T becomes a double sequence 
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(Chapter 1, 89). Writing m and n for x and y, and um,» for f(x, y), we then 
obtain Osgood’s theorem for double sequences (also called the Moore—Smith 
theorem) as follows. 


Theorem 2’. Let {umn} be a double sequence in a complete space (T, p’). If 


lim Umn = Wm exists for each m 
Noo 


and if 


lim Umn = Pn (uniformly in n) likewise exists, 
m—- oo 


then the double limit and the two iterated limits of {Umn} exist and 


lit tis, = im lim wv, = lim lim uy. 
atc n—>co m—-co m—>oo n—0o 


Here the assumption that lim 300 Umn = Pn (uniformly in n) means, by 
(5), that 


We>0) Gk) Wn) Vm>k) pltmn: Pa) <e- (7) 


Similarly, the statement “ lim mn = 8” (see (2)) is tantamount to 


N— oo 


(Ye>0) Sk) Wm, >k) play spe. (8) 


Note 4. Given any sequence {z,,} C (S, 9), we may consider the double 
limit lim. P(Lm, Tn) in FE}. By using (8), one easily sees that 
N—- Ooo 
im, p(fm, En) = 0 
noo 


iff 


Ve>0) (2k) Wm. n> kh) plan, ty) <<, 


ie., iff {%} is a Cauchy sequence. Thus Cauchy sequences are those for which 
lm, P(Zm; Ln) = 0. 

Noo 

Theorem 3. In every metric space (S, p), the metric p: (S x S) > E' is a 
continuous function on the product space S x S. 


Proof. Fix any (p,q) € S x S. By Theorem 1 of §2, p is continuous at (p, ¢) 
iff 


pl tm, Ym) > (Dp, q) whenever (Divs Yrn) > (p, q); 


i.e., whenever 2, — p and ym — gq. However, this follows by Theorem 4 in 
Chapter 3, §15. Thus continuity is proved. 
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Problems on Double Limits and Product Spaces 


. Prove Theorem 1(i). Prove Theorem 1 (ii) for both choices of p, as sug- 


gested. 


. Formulate Definitions 2 and 3 for the cases 


() p=q=s5= +003 
(ii) p= +00, q € E1, s = —00; 


i) 
(iii) p € E', q=s = —00; and 
v) p 


(i 


p= q=s5=—-&. 


. Prove Theorem 2’ from Theorem 2 using Theorem 1 of §2. Give a direct 


proof as well. 


. Define f: E* 4 E} by 


TY 
x? + y? 
see $1, Example (g). Show that 


f(z, y) = if (x, y) - (0, 0), and 70, 0) = 0; 


lim lim, 2.0) =0= Tim, po becomes 


y—0 x0 


but 


lim f(x, y) does not exist. 
«z—0 
y0 


Explain the apparent failure of Theorem 2. 
Define f: E? > E' by 
f(x, y) =0 if cy = 0 and f(z, y) = 1 otherwise. 


Show that f satisfies Theorem 2 at (p, q) = (0, 0), but 
lim f(a, y) 


(x, y)>(p, a) 


does not exist. 


- Do Problem 4, with f defined as in Problems 9 and 10 of 83. 
. Define f as in Problem 11 of §3. Show that for (c), we have 


lim L, = lim 7 (4; = lim lim, ae = 0, 
a ee y) = aa y) = Lees f(z, y) 


but lim lim f(z, y) does not exist; for (d), 
y0 x0 


lim lim, feo =t, 


y—0 x0 
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10. 


but the iterated limits do not exist; and for (e), lim f(a, y) fails 
; (x, y)—(0, 0) 
to exist, but 


lim fF (297) = lie Tie fae, gy) = Ti Te fe, = 0 
cae y0 x0 xz—0 y>0 


Give your comments. 


. Find (if possible) the ordinary, the double, and the iterated limits of f 


at (0, 0) assuming that f(z, y) is given by one of the expressions below, 
and f is defined at those points of E? where the expression has sense. 


2 


(i) x ; (ii y sin ry — 
2 + y? 2 2 + y? 2 
2 3 
(ity (vy) Se: 
cry xu +y 
oy) Pav vi a> + y4 
v) =— Vi) —-—__ ==: 
x2 + y2’ (x2 + y)2 
Re y+an-2-7 - sin ry 
(vil) —_—__—3 (viii) —————_ 
A+2Z sinz-siny 


. Solve Problem 7 with x and y tending to +00. 


. Consider the sequence Umn in E! defined by 


m+ 2n 
mtn 


Umn 


Show that 


hme him, =2 end lim: lim a. — 1, 
moo n->ooO noo mM—->0oO 


but the double limit fails to exist. What is wrong here? (See Theo- 
rem 2’.) 


Prove Theorem 2, with (i) replaced by the weaker assumption (“subuni- 
form limit” ) 


(Ve > 0) (Ad > 0) (Va € Gip(d)) (Wy € Gag(d))  plg(), F(®, y)) <€ 


and with iterated limits defined by 


$ = lim: lim f(2,y) 


iff (Ve > 0) 
(40 > 0) (Va € Gip(5')) (Ady > 0) (Vy € Gag(Sz)) (f(y), 8) <e. 
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17. 


18. 


19. 


20. 
21. 
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Does the continuity of f on X x Y imply the existence of (i) iterated 
limits? (ii) the double limit? 
[Hint: See Problem 6.] 


Show that the standard metric in E! is equivalent to p’ of Problem 7 in 
Chapter 3, §11. 


Define products of n spaces and prove Theorem 1 for such product 
spaces. 


Show that the standard metric in E” is equivalent to the product metric 
for E” treated as a product of n spaces E'. Solve a similar problem for 
CGC’, 

[Hint: Use Problem 13.] 

Prove that {(@m, Ym)} is a Cauchy sequence in X x Y iff {x,,} and 
{Ym} are Cauchy. Deduce that X x Y is complete iff X and Y are. 


Prove that X x Y is compact iff X and Y are. 
[Hint: See the proof of Theorem 2 in Chapter 3, §16, for E?.] 


(i) Prove the uniform continuity of projection maps P, and P2 on 
X x Y, given by Pi(z, y) =a and Po(az, y) = y. 
(ii) Show that for each open set Gin X x Y, P[G] is open in X and 
P2|G] is open in Y. 
[Hint: Use Corollary 1 of Chapter 3, §12.] 
(iii) Disprove (ii) for closed sets by a counterexample. 


[Hint: Let X x Y = E?. Let G be the hyperbola xy = 1. Use Theorem 4 of 
Chapter 3, §16 to prove that G is closed.] 


Prove that if X x Y is connected, so are X and Y. 

[Hint: Use Theorem 3 of §10 and the projection maps P; and P2 of Problem 17.] 
Prove that if X and Y are connected, so is X x Y under the product 
metric. 

[Hint: Using suitable continuous maps and Theorem 3 in §10, show that any two 


“lines” « = p and y = q are connected sets in X x Y. Then use Lemma 1 and 
Problem 10 in §10.] 


Prove Theorem 2 under the weaker assumptions stated in footnote 1. 


Prove the following: 
(it 


g(x) = lim f(x,y) and H = lim f(z, y) 
yd 


exist for ¢ € G_,(r) and y € G_,(r), then 


lim lim f(z, y) = H. 
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(ii) If the double limit and one iterated limit exist, they are necessarily 
equal. 


22. In Theorem 2, add the assumptions 
h(y) = f(p, y) for ye Y — {q} 


and 
g(x) = f(z, q) for xe X — {p}. 


Then show that 


lim x, 
(x, y)>(p, a) Hay) 


exists and equals the double limits. 
[Hint: Show that here (5) holds also for « = p and y € G—,(6) and for y = q and 
z € Gap(6), 


23. From Problem 22 prove that a function f: (X x Y) > T is continuous 
at (p, q) if 
f(p, y) = lim f(a, y) and f(x, q) = lim f(a, y) 


for (x, y) in some G'p, g)(d), and at least one of these limits is uniform. 


§12. Sequences and Series of Functions 


I. Let 
Ths fa, a) eee Beart 


be a sequence of mappings from a common domain A into a metric space 
(T, p').’ For each (fixed) x € A, the function values 


fi); Foy cans Frees 


form a sequence of points in the range space (T, p’). Suppose this sequence 
converges for each x in a set B C A. Then we can define a function f: B > T 
by setting 

f(z)= lim fale) forallae B. 


m—-> co 


This means that 


(Ve >0) (Vx € B) (Sk) (Vm >k) pl (f(x), f(x) <e. (1) 


Here k depends not only on € but also on x, since each x yields a different 
sequence { f,,(x)}. However, in some cases (resembling uniform continuity), k 


1 We briefly denote such a sequence by fm: A — (T, p’). 
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depends on € only; i.e., given € > 0, one and the same k fits all x in B. In 
symbols, this is indicated by changing the order of quantifiers, namely, 


k) (Ve B)(Vm>k) p'(fm(x), f(@)) <e. (2) 


(Ve > 0) (J 


Of course, (2) implies (1), but the converse fails (see examples below). This 
suggests the following definitions. 


Definition 1. 


With the above notation, we call f the pointwise limit of a sequence of 
functions f, on a set B (B C A) iff 


f(“)= im Fave) for all im B- 
i.e., formula (1) holds. We then write 
fin 2 f (pointwise) on B. 
In case (2), we call the limit uniform (on B) and write 


fim 2 f (uniformly) on B. 


II. If the f,, are real, complex, or vector valued (§3), we can also define 
Sm = >-,-1 fe (= sum of the first m functions) for each m, so 


(Vee A) (Vm) Sm(x)= 5° f(z). 
k=1 


The s,, form a new sequence of functions on A. The pair of sequences 


({fm}, {8m}) 


is called the (infinite) series with general term fm; Sm is called its mth partial 
sum. The series is often denoted by symbols like $3 fm, 53 fim(x), ete. 


Definition 2. 


The series )> f, on A is said to converge (pointwise or uniformly) to a 
function f on a set BC A iff the sequence {s,,} of its partial sums does 
as well. 


We then call f the sum of the series and write 


f(2)= S- fe() or y= S- tn. = IS, 
k=1 


m=1 


(pointwise or uniformly) on B. 


Note that series of constants, )> Cm, may be treated as series of constant 
functions fm, with fm(x) = Cm for x € A. 
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If the range space is FE! or E*, we also consider infinite limits, 


lini f(t) = ho: 


m—> oo 


However, a series for which 


. Pe = MS 
m=1 


is infinite for some zx is regarded as divergent (i.e., not convergent) at that x. 


III. Since convergence of series reduces to that of sequences {5}, we shall 
first of all consider sequences. The following is a simple and useful test for 
uniform convergence of sequences f,,: A — (T, p’). 


Theorem 1. Given a sequence of functions fim: A — (T, p’), let BC A and 
Qm = sup DO tal®); f(2)). 


xeEB 
Then fm — f (uniformly on B) iff Qm — 0. 
Proof. If Q,, — 0, then by definition 


(Ve >0) (3k) (Vm>k) Qin <e. 


However, Q,, is an upper bound of all distances p'(fim(x), f(xz)), « € B. Hence 
(2) follows. 
Conversely, if 


(VE B) p'(fm(), f(x)) <e, 


then 


eS sup p'(fm(2), FS); 


i.e., Qm <¢. Thus (2) implies 


(Ve>0) (Ak) (Vm>k) Qm<e 


and Qm 70. O 


Examples. 
(a) We have 


lm ee Qt |e) < and lime = fe = 1, 
noo n— oo 
Thus, setting f,(x) = 2”, consider B = (0, 1] and C = (0, 1). 


We have f,, > 0 (pointwise) on C and f, > f (pointwise) on B, with 
f(x) = 0 for x € C and f(1) = 1. However, the limit is not uniform on 


230 Chapter 4. Function Limits and Continuity 


C, let alone on B. Indeed, 


Qn = sup |fn(x) — f(x)| = 1 for each n.? 
xrEC 


Thus Q,, does not tend to 0, and uniform convergence fails by Theorem 1. 
(b) In Example (a), let D = [0, a], 0 <a<1. Then f, — f (uniformly) on 


D because, in this case, 


Qn = sup |fn(z) — f(x)| = sup |x” — 0] =a" > 0. 
xED xED 


(c) Let 


fal(z) = 27 + a a € Ef. 


For a fixed x, 


sin nx 


iL 
|< = 0. 
nm 


lim fp(x) =x? since 


noo n 


Thus, setting f(x) = x7, we have f, — f (pointwise) on E'. Also, 


sin nx 1 
— — < — 
in(z) — F@)| = || <= 
Thus (Vn) Qn < + —+ 0. By Theorem 1, the limit is uniform on all of 


F}, 


Note 1. Example (a) shows that the pointwise limit of a sequence of con- 
tinuous functions need not be continuous. Not so for uniform limits, as the 
following theorem shows. 


Theorem 2. Let f,, : A— (T, p’) be a sequence of functions on A C (S, p). If 
fim 2 f (uniformly) on a set B C A, and if the fm are relatively (or uniformly) 
continuous on B, then the limit function f has the same property. 


Proof. Fix ec >0. As fm — f (uniformly) on B, there is a k such that 


(VxeB)(Vm>k) p'(fm(z), f(2)) <5. (3) 


Take any fm with m > k, and take any p € B. By continuity, there is 6 > 0, 
with 


! & 
(V2 BNG,()) p(fm(2), fm(p)) <7 - (4) 
? Here 
Qn = sup |x” —0|= sup x” = lima” =1 
rec O0<e<1 r—r1 


by Theorem 1 of 85, because x” increases with « 1, i.e., each fn is a monotone function 
on C. Note that all fn are continuous on B = (0, 1], but f = lim fp is discontinuous at 1. 
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Combining this with 


ALO 


Also, setting x = p in (3) gives p'(fim(p), f(p)) < 
(4) and (3), we obtain (Vz € BN G,(6)) 
p'(f (x), F(p)) < oF), fm(2)) + 0" fm (2), fm(p)) + 0" fm(P), F(p)) 
< : cs 7 a : < es 
We thus see that for p € B, 


(Ve >0) (36 >0) Vae BNG,(4)) p'(f(a), f(P)) <e, 


i.e., f is relatively continuous at p (over B), as claimed. 
Quite similarly, the reader will show that f is uniformly continuous if the 
fn are. 


Note 2. A similar proof also shows that if f,, > f (uniformly) on B, and 
if the fm, are relatively continuous at a point p € B, so also is f. 


Theorem 3 (Cauchy criterion for uniform convergence). Let (T, p’) be com- 
plete. Then a sequence fm: A —>T, A C (S,p), converges uniformly on a set 
BCA TT 


(We>0) Gk) (Vee B) Vman>k) 6 fel); falz)) <e. (5) 


Proof. If (5) holds then, for any (fixed) x € B, {fim(x)} is a Cauchy sequence 
of points in T, so by the assumed completeness of T, it has a limit f(x). Thus 
we can define a function f: B — T with 

f(a) = lim. fm(#) on B. 

To show that fin — f (uniformly) on B, we use (5) again. Keeping «, k, 
x, and m temporarily fixed, we let n — co so that f,(x) > f(x). Then by 
Theorem 4 of Chapter 3, §15, p’(fm(x), fn(x)) > pv’ (f(x), fm(x)). Passing to 
the limit in (5), we thus obtain (2). 

The easy proof of the converse is left to the reader (cf. Chapter 3, §17, 
Theorem 1). 


IV. If the range space (T, p’) is E', C, or E” (*or another normed space), 
the standard metric applies. In particular, for series we have 


p'(8m(2), 8n(@)) = |$n(#) — 8m(@)| 


=|S0 f(x) — So fe(x) 
k=1 k=1 
=| >) fala) 


k=m+1 


form <n. 
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Replacing here m by m—1 and applying Theorem 3 to the sequence {s,,,}, we 
obtain the following result. 


Theorem 3’. Let the range space of fm, m=1, 2,..., be E*, C, or E” (*or 
another complete normed space). Then the series \> fm converges uniformly 
on B iff 


(Ve >0) (Aq) Vn >m>q) (VrE B) 


<eé. (6) 


IEC 
k=m 


Similarly, via {s,,}, Theorem 2 extends to series of functions. (Observe that 
the s,, are continuous if the f,, are.) Formulate it! 


V. If So, fm exists on B, one may arbitrarily “group” the terms, i.e., re- 
place every several consecutive terms by their sum. This property is stated 
more precisely in the following theorem. 


Theorem 4. Let 
c= as fim (pointwise) on B.® 
m=1 


Let my < mz <-+++< my <--- in N, and define 
91 =S$mi, Jn = Smn — Smyn_-1, > 1. 


(Thus gn+i = fmatit--*+ Trin tens) Then 


f= >; Gn (pointwise) on B as well; 
n=1 
similarly for uniform convergence. 


Proof. Let 


nm 


n= > Gk: a re 


k=1 


S 


Then si, = Sm, (verify!), so {sj} is a subsequence, {Sm,}, of {5m}. Hence 
Sm — f (pointwise) implies s', > f (pointwise); i.e., 


l= > gn (pointwise). 


n=1 


For uniform convergence, see Problem 13 (cf. also Problem 19). 


3 Here we allow also infinite values for f(x) if the fm are real. 
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Problems on Sequences and Series of Functions 


. Complete the proof of Theorems 2 and 3. 
. Complete the proof of Theorem 4. 
. In Example (a), show that f, — +00 (pointwise) on (1, +00), but not 


uniformly so. Prove, however, that the limit is uniform on any interval 
[a, +00), a > 1. (Define “lim f, = +00 (uniformly)” in a suitable 
manner. ) 


. Using Theorem 1, discuss lim fn on B and C (as in Example (a)) for 


n> 


each of the following 
(i) f(x) = — Bek; C =(a,0 Cc E': 


(ii) fax) = a B= Et. 
(iii) fir( =e —1, 1); C = [-a, al, |a| < 1. 
(iv) fa(z) = = 2, C = [0, +00). 


1 1 
[Hint: Prove that Qn = sup — (1 — ) = 
n na+1 


1 
(Vv) Jule) tos" a B= (0, =), C= [7 =); 


sin? nx 


(vi) fale) = ae B=E'. 
a = — B= 0.41). 0= (00.0021. 


. Using Theorems 1 and 2, discuss lim f, on the sets given below, with 


fn(xz) as indicated and 0 < a < +00. (Calculus rules for maxima and 
minima are assumed known in (v), (vi), and (vii).) 


(i) — [a, +00), (0, a). 
(ii) asi (@, +00), (0, a). 


(iii) ~/cosa: (0, *), (0, a],a< 

(iv) =; (0, a), (0, +00). 

(v) re~"*; [0, +00); E?. 

(vi) nze~"*; [a, +00), (0, +00). 
) 


(vii) nxe ne? [a, +00), (0, +00). 
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=>9. 


=10. 
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[Hint: lim fn cannot be uniform if the fp, are continuous on a set, but lim fy is not. 
For (v), fn has a maximum at 2 = 4, hence find Qn.] 


. Define f,: E! — E' by 


na ifd0<a< i. 
fn(z) = <4 2-—nex if <a <#, and 
0 otherwise. 


Show that all f, and lim f, are continuous on each interval (—a, a), 
though lim f,, exists only pointwise. (Compare this with Theorem 3.) 


. The function f found in the proof of Theorem 3 is uniquely determined. 


Why? 


Prove that if the functions f, are constant on B, or if B is finite, then 
a pointwise limit of the f, on B is also uniform; similarly for series. 


Prove that if f, — f (uniformly) on B and if C C B, then f, — f 
(uniformly) on C as well. 


Show that if f, — f (uniformly) on each of Bi, Bo, ..., Bm, then fn > 
f (uniformly) on U7, Br. 
Disprove it for infinite unions by an example. Do the same for series. 


Let f, — f (uniformly) on B. Prove the equivalence of the following 
statements: 


(i) Each f,, from a certain n onward, is bounded on B. 


(ii) f is bounded on B. 


(iii) The f, are ultimately uniformly bounded on B; that is, all function 
values f,(x), x € B, from a certain n = no onward, are in one and 
the same globe G,(/c) in the range space. 

For real, complex, and vector-valued functions, this means that 


(AK € E*) (Vn>n9) (V2EB) |fn(x)| < K. 


. Prove for real, complex, or vector-valued functions fr, f, gn, g that if 


fn > f and gn > g (uniformly) on B, 


then also 
fn £9n 2 f +g (uniformly) on B. 


Prove that if the functions f,, and g, are real or complex (or if the g, 
are vector valued and the f, are scalar valued), and if 


fn 2 f and gn > g (uniformly) on B, 
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=>13. 


=>14. 


=>15. 


then 
fn9n 2 fg (uniformly) on B 


provided that either f and g or the fn and gn are bounded on B (at 
least from some n onward); cf. Problem 11. 

Disprove it for the case where only one of f and g is bounded. 
[Hint: Let fn(x) = x and gn(x) = 1/n (constant) on B = E!. Give some other 
examples.] 
Prove that if {fn} tends to f (pointwise or uniformly), so does each 
subsequence { fn, }. 


Let the functions f, and g,, and the constants a and b be real or complex 
(or let a and b be scalars and f,, and g,, be vector valued). Prove that if 


f= iS fn and g = i gn (pointwise or uniformly), 


n=1 n=1 
then 
[o-e) 
af +bg= S (afin + bgn) in the same sense. 
n=1 


(Infinite limits are excluded.) 
In particular, 


ftg= Sn + gn) (rule of termwise addition) 


n=1 


and 
a = S- cae 
n=1 


[Hint: Use Problems 11 and 12.] 


Let the range space of the functions f,, and g be E” (*or C”), and let 
tee Fels Irae es ele GS (Six o cy Oe); BES 83, part tl, Prove thas 


fm —g (pointwise or uniformly) 


iff each component fmx of fm converges (in the same sense) to the 
corresponding component gx of g; i.e., 


fmk 2 9x (pointwise or uniformly), k = 1, 2,..., n. 


Similarly, 
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=17. 


=>18. 


19. 


20. 


21. 
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iff 
CO 
(VESn) ge= >) Smx- 
m=1 


(See Chapter 3, §15, Theorem 2). 


From Problem 15 deduce for complex functions that f,, — g (pointwise 
or uniformly) iff the real and imaginary parts of the f,, converge to those 
of g (pointwise or uniformly). That is, (fm)re 4 Gre and (fm)im > Jim} 
similarly for series. 
Prove that the convergence or divergence (pointwise or uniformly) of a 
sequence {f,,}, or a series }> f,, of functions is not affected by deleting 
or adding a finite number of terms. 

Prove also that limm-oo fm (if any) remains the same, but \>°_, fim 
is altered by the difference between the added and deleted terms. 


Show that the geometric series with ratio r, 
Soar” “rel oreare Cc), 
n=0 


converges iff |r| < 1, in which case 


= a 

) ar” = 
l-r 

n=0 


(similarly if a@ is a vector and r is a scalar). Deduce that 5>(—1)” 
diverges. (See Chapter 3, §15, Problem 19.) 


Theorem 4 shows that a convergent series does not change its sum if 
every several consecutive terms are replaced by their sum. Show by an 
example that the reverse process (splitting each term into several terms) 
may affect convergence. 


[Hint: Consider SS an with an = 0. Split an = 1— 1 to obtain a divergent series: 
>-(—1)"—1, with partial sums 1, 0, 1, 0, 1,....] 


== 1 
Find ——_—~. 
> n(n +1) 
[Hint: Verify: aE = 4 — a Hence find sy, and let n > oo.] 
The functions f,: A — (T, p’), A C (S, p) are said to be equicontinuous 
at p€ A iff 


(Ve > 0) (45 >0) (Vn) (Va EANG,(5))  p'(fn(@), fn(p)) <é. 


Prove that if so, and if f, > f (pointwise) on A, then f is continuous 
at p. 
[Hint: “Imitate” the proof of Theorem 2.] 


§13. Absolutely Convergent Series. Power Series 237 


§13. Absolutely Convergent Series. Power Series 


I. A series }> fm is said to be absolutely convergent on a set B iff the 
series 5) |fm(x)| (briefly, 5>|fm|) of the absolute values of fm converges on B 
(pointwise or uniformly). Notation: 


f= Ss |fm| (pointwise or uniformly) on B. 


In general, S> f, may converge while }>|f,,| does not (see Problem 12). In 
this case, the convergence of )> f;, is said to be conditional. (It may be absolute 
for some x and conditional for others.) As we shall see, absolute convergence 
ensures the commutative law for series, and it implies ordinary convergence 
(i.e., that of >> f,,), if the range space of the f,, is complete. 


Note 1. Let 
k=1 


Then 
1 
Om+1 = 9m + Toei | > Om On B; 


i.e., the Om(x) form a monotone sequence for each x € B. Hence by Theorem 3 
of Chapter 3, 815, 


CO 
Litt Cg = y |fm| always exists in E*; 
m—- oo 


m=1 


| fm| converges iff >°_, |fm| < +00. 
For the rest of this section we consider only complete range spaces. 


Theorem 1. Let the range space of the functions fm (all defined on A) be E’, 
C, or E” (*or another complete normed space). Then for B C A, we have the 
following: 


(i) If So |fm| converges on B (pointwise or uniformly), so does \> fim itself. 


Moreover, 
CO CO 
3 fmf S Do Ml om B 
m=1 m=1 


(ii) (Commutative law for absolute convergence.) If >> |fm| converges (point- 
wise or uniformly) on B, so does any series \> |gm| obtained by rearrang- 


We write “f < g on B” for “(Vx € B) f(x) < g(x);” similarly for such formulas as 
“f =gon B,” “|f| <+oco on B,” “f =c (constant) on B,” etc. 
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ing the fm in any different order.?, Moreover, 


ee fm = 3 Gm (both exist on B). 
m=1 m=1 


Note 2. More precisely, a sequence {gm} is called a rearrangement of { fm} 
iff there is a map wu: N — N such that 
onto 


(Vm E N) Im = Fite 


Proof. 
(i) If }>|fm| converges uniformly on B, then by Theorem 3’ of §12, 


(Ve >0) (Sk) Vn >m>k) (Var e€ B) 


E> S° |fn(@)| = 
k=m 


(triangle law). (1) 


S- fx(a) 
k= 


However, this shows that 5° f, satisfies Cauchy’s criterion (6) of $12, so 
it converges uniformly on B. 
Moreover, letting n — oo in the inequality 


LS fn = Fels 
m=1 m=1 


we get 


De fn = », l|fm| <+oo on B, as claimed. 
m= 


m=1 
By Note 1, this also proves the theorem for pointwise convergence. 
(ii) Again, if 5° |f,,| converges uniformly on B, the inequalities (1) hold for 
all f; except (possibly) for fi, fo, ..-, fr. Now when > fm is rearranged, 


these k functions will be renumbered as certain g;. Let gq be the largest 
of their new subscripts 7. Then all of them (and possibly some more 


functions) are among g1, 92, ---, Gq (so that q > k). Hence if we exclude 
Ji, +++; 9q, the inequalities (1) will certainly hold for the remaining g; 
(i > q). Thus 


n 


S- gil: 


=m 


(Ve > 0) (Aq) (Yn >m > q) (Va € B) e> > Igil 2 (2) 


By Cauchy’s criterion, then, both >> g; and }>|g;| converge uniformly. 


? This fails for conditional convergence. See Problem 17. 
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Moreover, by construction, the two partial sums 


k q 
/ 
sr=) fi and s,= 5 I 


can differ only in those terms whose original subscripts (before the re- 
arrangement) were > k. By (1), however, any finite sum of such terms is 
less than € in absolute value. Thus |s/, — sx| < €. 

This argument holds also if & in (1) is replaced by a larger integer. 
(Then also q increases, since gq > k as noted above.) Thus we may let 
k — +00 (hence also q +00) in the inequality |s, — sx| < €, with ¢ 


fixed. Then - so 
Sh fm and s, > SG 
m=l i=1 


sO 


So oi _ S- fn Sor 
i=1 m=1 


Now let ¢ — 0 to get 


So gi — »S fm; 
w=1 m=1 


similarly for pointwise convergence. 


II. Next, we develop some simple tests for absolute convergence. 


Theorem 2 (comparison test). Suppose 
(Vm) |fml S|9ml on B. 
Then 


() So lfml < 32 aml on Bs 
m=1 m=1 


(ii) Ss" | fm| = +co implies S- lGm| = +coo on B; and 


m=1 m=1 


(iii) Jf S lgm| converges (pointwise or uniformly) on B, so does x Fale 


Proof. Conclusion (i) follows by letting n > oo in 


oS lfm| < > |9m|- 
m=1 m=1 


In turn, (ii) is a direct consequence of (i). 
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Also, by (i), 


i» \dm| < -++oo implies ys lfm| < --oo. 


This proves (iii) for the pointwise case (see Note 1). The uniform case follows 
exactly as in Theorem 1(i) on noting that 


S— I fel < S5 lanl 
k=m k=m 


and that the functions |f;,| and |gz| are real (so Theorem 3’ in §12 does ap- 
ply). O 


Theorem 3 (Weierstrass “M-test”). If }> M,, is a convergent series of real 
constants M,, > 0 and if 


(Vn) |fnl < Mn 


on a set B, then S>|fn| converges uniformly on B.2 Moreover, 


5 Ital < My on B. 
n=1 n=1 


Proof. Use Theorem 2 with |g,,| = /,,, noting that 5° |g,| converges uniformly 
since the |g,| are constant (§12, Problem 7). 


Examples. 
(a) Let 
1, 0 1 
ine) = (5 sin) on E’. 
Then 
(Vn) (Vee E*) |fr(x)| <2, 


and ) > 2~” converges (geometric series with ratio 3; see §12, Problem 18). 
Thus, setting M,, = 2~” in Theorem 3, we infer that the series }> |} sin z|” 
converges uniformly on E', as does (3 sin x)"; moreover, 


Se) =, 
n=1 n=1 


3So does >> fn itself if the range space is as in Theorem 1. Note that for series with 
positive terms, absolute and ordinary convergence coincide. 
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Theorem 4 (necessary condition of convergence). If >> fm or >>|fm| con- 
verges on B (pointwise or uniformly), then |fm| — 0 on B (in the same sense). 


Thus a series cannot converge unless its general term tends to 0 (respec- 


tively, 0). 
Proof. If So fm = f, say, then s,, > f and also s,,_1 + f. Hence 
Sm — 8m-1 > f —f =0. 


However, 8m — Sm—1 = fm. Thus fm — 0, and |f;,| + 0, as claimed. 


This holds for pointwise and uniform convergence alike (see Problem 14 in 
812). O 


Caution: The condition |f,,| — 0 is necessary but not sufficient. Indeed, 
there are divergent series with general term tending to 0, as we show next. 


Examples (continued). 


1 
(b) >. = +00 (the so-called harmonic series). 
n=1 


Indeed, by Note 1, 

0 en 
‘ — exists (in E*), 
n=1 m 


so Theorem 4 of 812 applies. We group the series as follows: 


ee ee +—)+ 

nn i ae 5 6 7 8 9 16 
>otot(Sts)+(stetets)t (st +=) + 
a ee ae 8° 8'8' 8 16 16 


Each bracketed expression now equals 4. Thus 


1 1 
= am: Im = 5: 


AS gm does not tend to 0, 5° gm diverges, i.e., \>_1 Gm is infinite, by 
Theorem 4. A fortiori, so is }77°_, 4. 
Theorem 5 (root and ratio tests). A series of constants )> an (\an| 4 0) 
converges absolutely if 


lim */Jaa| <1 or Tim(“41!) <1, 
an 
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It diverges if 
lim ¥/|an| > 1 or Jim (Set! Bett!) > 1. 


It may converge or diverge if 


lim Y|a,|=1 


jim (eet!) 24 < Tim ( S44), 
a lar. - lan| 


(The ay may be scalars or vectors.) 


Proof. If lim %/]a,| < 1, choose r > 0 such that 


lim */la,| <r <1. 


Then by Corollary 2 of Chapter 2, $13, %/|a,| <r for all but finitely many n. 
Thus, dropping a finite number of terms ($12, Problem 17), we may assume 
that 


or if 


lial <r for all ni: 


As 0 <r <1, the geometric series }*r” converges. Hence so does )> |a,,| by 


Theorem 2. 
Tim (e+!) cae 
|an| 


we similarly obtain (dm) (Vn > m) |an4i| < |an|r; hence by induction, 


(Vn >m) |an| <|an|r"~™. (Verify!) 


In the case 


Thus )> |a,| converges, as before. 


Iflim %/|a,| > 1, then by Corollary 2 of Chapter 2, §13, |a,,| > 1 for infinitely 
many n. Hence |a,| cannot tend to 0, and so )*a,, diverges by Theorem 4. 


jim (Set!) > 1, 


——\ |an| 


Similarly, if 


then |an41] > |an| for all but finitely many n, so |a,| cannot tend to 0 again.° 


Note 3. We have 


tim (4241!) <lim V/|an| < lim ¥/Jan| < lim (aa a 


| [an 


4 Note that we have “lim”, not “Tim” here. However, often “lim” and “Tim” coincide. This 
is the case when the limit exists (see Chapter 2, §13, Theorem 3). 

5 This inference would be false if we only had Tim(|an41|/|an|) > 1. Why? 

° For a proof, use Problem 33 of Chapter 3, §15 with x1 = |ai| and zg41 = |ax41|/lag|- 
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Thus 
Tim (e+!) <1 implies lim ¥/|an| < 1; and 


lan 


jim (Se#1!) > 1 implies lim ¥/|a,| > 1. 


——\ |an| 


Hence whenever the ratio test indicates convergence or divergence, so certainly 
does the root test. On the other hand, there are cases where the root test yields 
a result while the ratio test does not. Thus the root test is stronger (but the 
ratio test is often easier to apply). 


Examples (continued). 
(c) Let a, = 27* if n = 2k —1 (odd) and a, = 3-* if n = 2k (even). Thus 


_ 1 1 1 1 1 1 1 
Drakes ae ga oe 


Here 
" 37k Ja. 9-k-1 
lim(“ =) = lim —-=— 1) and lim(“ =) = fam = +00, 
=p, k—00 27k An k-co 37% 
while 


lim */a, = lim *"W/2-" = S <1.’ (Verify!) 


Thus the ratio test fails, but the root test proves convergence. 


Note 4. The assumption |a,,| 4 0 is needed for the ratio test only. 


III. Power Series. As an application, we now consider so-called power 


series, 
> An (x a Pp)", 
where x, p, an € E+ (C); the a, may also be vectors. 


Theorem 6. For any power series )>an(x — p)", there is a unique r © E* 
(0 < r < +00), called its convergence radius, such that the series converges 
absolutely for each x with |x—p| < r and does not converge (even conditionally) 
if |z—pl>r8 

Specifically, 


1 = 
r= where d= lim V/|an|_ (with r = +00 if d=0). 


” Recall that lim and lim are cluster points, hence limits of suitable subsequences. See 
Chapter 2, §13, Problem 4 and Chapter 3, §16, Theorem 1. 
8 The case |a2 — p| = r remains open. 
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Proof. Fix any = zo. By Theorem 5, the series }>a,(x%9 — p)” converges 
absolutely if lim %/Ja,||ao — p| <1, ice., if 


1 1 
Lo —- pl <r (r= —_ = -), 
[Zo — p| Tim </ja] 


and diverges if |zq — p| > r. (Here we assumed d ¥ 0; but if d = 0, the 
condition d|xo — p| < 1 is trivial for any xo, so r = +00 in this case.) Thus r 
is the required radius, and clearly there can be only one such r. (Why?) 


Note 5. If lim [Groth exists, it equals lim ¥/|a,|, by Note 3 (for lim and 
N+ Co 


noo |Qy| 


lim coincide here). In this case, one can use the ratio test to find 


and hence (if d 4 0) 


1 : lan| 
r=—= lm : 
dd n-00 |an+1 


Theorem 7. [f a power series \\a,(x — p)” converges absolutely for some 
x=2X40 #p, then >> |an(x—p)”"| converges uniformly on the closed globe Gp(60), 
6 = |ro—p|. So does \\an(a—p)” if the range space is complete (Theorem 1). 


Proof. Suppose > |an(xo — p)”| converges. Let 
6 = |zo — p| and M,, = |a,|6”; 


thus }> M,, converges. 
Now if x € G,(6), then |x — p| < 6, so 


|an(a — p)"| < |an|d" = Mn. 


Hence by Theorem 3, )> |a,(x — p)”| converges uniformly on G,(6). O 
Examples (continued). 


(d) Consider S- — Here 


1 An 
p=0and a, = —, so lan| 


, =n+1—- +00. 
n! |an+4| 


By Note 5, then, r = +00; i.e., the series converges absolutely on all of 
E'. Hence by Theorem 7, it converges uniformly on any Go(5), hence on 
any finite interval in E!. (The pointwise convergence is on all of E+.) 
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More Problems on Series of Functions 


1. Verify Note 3 and Example (c) in detail. 


2. Show that the so-called hyperharmonic series of order p, 


ye (pe E), 


converges iff p > 1. 
[Hint: If p <1, 


> _ > S- - =-+oo (Example (b)). 


a convergent geometric series. Explain each step.] 


=>3. Prove the refined comparison test: 


(i) If two series of constants, 5>|an| and >> |b,|, are such that the 
sequence {|ap|/|bn|} is bounded in E+, then 


ys lbn| < +oo implies > lan| < --oo. 
n=1 n=1 
(ii) If 
an 


0< lim — <+4+o, 


noo |b,| 
then >> |a,| converges if and only if >> |b,| does. 
What if 


[Hint: If (Vn) |an|/lbn| < K, then |an| < K|bn|.] 


4. Test 5° a, for absolute convergence in each of the following. Use Prob- 
lem 3 or Theorem 2 or the indicated references. 


n+1 il 
i} dy = ———— (take b, = —); 
(i) aa ( 7) 
_ cos n 1 
(i) ag = Via (take b, = Vi use Problem 2); 
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Git) an = —" (Vn - vi): 


P 
(iv) @4:= a (use Problem 18 of Chapter 3, §15); 
(v) an = ee 
(7) an = Poin 3 a 
(vi) ay = OE ge Bt 


[Hint for (vi) and (vii): From Problem 14 in §2, show that 
lim = —— = 
y+ too (log y)4 
and hence , g 
fig OE 2G, 
n—- co n 


Then select bn.] 


Oo et 
nr 
5. Prove that » ar ++00. 
n=1 
[Hint: Show that n”/n! does not tend to 0.] 
nm 


6. Prove that lm ie 0. 


noo n! 
[Hint: Use Example (d) and Theorem 4.] 

7. Use Theorems 3, 5, 6, and 7 to show that >> |f,,| converges uniformly 
on B, provided f,(x) and B are as indicated below, with 0 < a < +00 
and b € E'.® For parts (ix)-(xii), find M, = maxzep|fn(x)| and use 
Theorem 3. (Calculus rules for maxima are assumed known.) 


0) So a,b) 
Gi) (-1)"" (an pli [—a, }. 
(iii _ [—a, al. 


n?a”; [—a, a] (a < 1). 


) 
) 
(v) —e B = E® (use Problem 2). 
) 
) 


S 
a 

= 

8 
2. 
=) 
> 
a 
eS 
g 


cosnx _ 
Vne +1’ 


9 For power series, do it in two ways and find the radius of convergence. 


B=’, 
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(viii) a, cosnz, with S- lan| < +00; B = E’. 
n=1 
(ix) 2”e~™*; [0, +00). 


(zy ee (06, 4]. 


(xi) (w loge)", fu(0) = 0; [-5, 5]. 
(xii) (722)", [1, +00). 


(xii) q(q—1)---(q—n+1)a” ge; | 1 5] 


n! 
=>8. (Summation by parts.) Let fn, hn, and gy be real or complex functions 


(or let f, and hy, be scalar valued and g, be vector valued). Let f, = 
hyn —hn-1 (n > 2). Verify that (Vm >n> 1) 


d_ feak = D> (he — hes) ge 
k=n+1 k=n+1 


m—-1 
= hinGm _ RnGaced — S- Ae(Gk+1 _ Jk): 
k=n+1 


[Hint: Rearrange the sum.] 


=>9. (Abel’s test.) Let the fr, gn, and hy, be as in Problem 8, with 
hn = >>, fi. Suppose that 


(i) 
(ii) |gn| + 0 (uniformly) on a set B; and 


i 
(iii) the partial sums hy, = )>;"_, fi are uniformly bounded on B; ie., 


the range space of the g, is complete; 


(AK € E') (Vn) |hn| < K on B. 


Then prove that >> f,g, converges uniformly on B if S> |gn41—gn| does. 
(This always holds if the g, are real and gp, > gn41 on B.) 
[Hint: Let ¢ > 0. Show that 


m 
dk) (Vm>n>k) S-> lgit1 — gil < € and |gn| < ¢ on B. 
i=n+l1 


— 
l 


Then use Problem 8 to show that 


m 
S> figi| < 3ke. 


i=n4+1 


Apply Theorem 3’ of §12.] 
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=> 9’. Prove that if S>a, is a convergent series of constants a, € E and if 
{by} is a bounded monotone sequence in £1, then > anbn, converges. 
[Hint: Let b, — b. Write 


anbn = An(bn — b) + anb 
and use Problem 9 with fn = an and gn = bn — 6.] 


=>10. Prove the Leibniz test for alternating series: If {bn }{ and b, — 0 in 
E', then }>(—1)"b,, converges, and the sum 5>~°_,(—1)"b,, differs from 
Sn = Dp—1(—1)* bx by bn4+1 at most. 
[Hint: Use Problem 9’.] 


=11. (Dirichlet test.) Let the fy, gn, and hy, be as in Problem 8 with \7*-_9 fn 
uniformly convergent on B to a function f, and with 


hn =—- 3 f, on B. 


i=n4+l1 
Suppose that 
(i) the range space of the g,, is complete; and 


(ii) there is K € E* such that 


|go| + a lQnt1— Gn| < K on B. 


n=0 


Show that 5° fngn converges uniformly on B. 


[Proof outline: We have 


n-1 n—-1 
|gn| = |g0 + 9° (9:41 — 9)| S l90l + D5 lgita — gil < K by (ii). 
Also, 
|hn| = bye: — i — 0 (uniformly) on B 


1=0 


by assumption. Hence 


(Ve >0) Gk) (VWn>k) |hn| < eon B. 
Using Problem 8, obtain 


>. fig 


i=n+i 


oy 


nP 


(Vm >n> k) < 2Ke.] 


12. Prove that if 0 < p< 1, then » 
[Hint: Use Problems 11 and 2.] 


converges conditionally. 
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=>13. Continuing Problem 14 in §12, prove that if S>|f,| and >> |g,| converge 
on B (pointwise or uniformly), then so do the series 


S— lafn + 0Gnl, > lfm Gn], and S~ lafnl: 


[Hint: Jafn + bgn| < ja||fn| + |bllgn|. Use Theorem 2.] 


For the rest of the section, we define 


+ 


x* = max(z,0) and « = max(—z, 0). 


=>14. Given {a,} C E* show the following: 
(i) Day + Lan = Vani. 
(ii) If Ss a < +00 or Daz < +00, then va, = Slat -—Soaz. 
(iii) If }° a, converges conditionally, then )> a = +00 = Yoaz. 
(iv) If S*Ja,| < +00, then for any {b,} Cc E’, 
S- lan + bn| < +00 iff 5 |bn| < 00; 
moreover, 5) Gn + >> by, = Do (Gn + bn) if D> by, exists. 


(Hint: Verify that |an| = a + an and an =a; — az. Use the rules of §4.] 


=>15. (Abel’s theorem.) Show that if a power series 
> ae =p)" (e,6 2,2, 9e EF") 
n=0 


converges for some x = 29 ¥ p, it converges uniformly on [p, Xo] (or 


[zo, p] if zo < p). 
[Proof outline: First let p = 0 and xp = 1. Use Problem 11 with 


fn = Gn and gn(x) = x2" = (ax — p)”. 


As fn = anl” = an(xo — p)”, the series 5> fn converges by assumption. The 
convergence is uniform since the fy, are constant. Verify that if = 1, then 


co 
S> lgn+1 — gel = 9, 
k=1 
and if0 <a <1, then 
CO co co 
os \Qk+1 — Gk] = S> a*|¢ —1| = (1-2) > a* =1 (a geometric series). 
k=0 k=0 k=0 


Also, |go(x)| = 2° = 1. Thus by Problem 11 (with K = 2), > fngn converges 
uniformly on [0, 1], proving the theorem for p = 0 and zo = 1. The general case 
reduces to this case by the substitution x — p = (ao — p)y. Verify!] 
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Prove that if _ 
0 < lima, < lima, < +00, 


then the convergence radius of }> a,(a — p)” is 1. 


Show that a conditionally convergent series ‘> an (an € E*) can be 
rearranged so as to diverge, or to converge to any prescribed sum 8. 
[Proof for s € E!: Using Problem 14(iii), take the first partial sum 


Of ew tat Ss 


Then adjoin terms 


—A,,—Ay,... 


> an 


until the partial sum becomes less than s. Then add terms ay until it exceeds s. 
Then adjoin terms —a, until it becomes less than s, and so on. 


As ae — 0 and a, — 0 (why?), the rearranged series tends to s. (Why?) 


Give a similar proof for s = too. Also, make the series oscillate, with no sum.] 


Prove that if a power series )> a,(a—p)” converges at some © = %p Fp, 
it converges absolutely (pointwise) on G,(d) if 6 < |xo — pj. 

[Hint: By Theorem 6, 6 < |xo — p| < r (r = convergence radius). Fix any « € Gp(6). 
Show that the line pe, when extended, contains a point x1 such that |x — p| < 


|z1 — p| <6 <r. By Theorem 6, the series converges absolutely at x1, hence at x as 
well, by Theorem 7.] 


Chapter 5 
Differentiation and Antidifferentiation 


§1. Derivatives of Functions of One Real Variable 


In this chapter, “E” will always denote any one of E', E*, C (the complex 
field), E”, *or another normed space. We shall consider functions f: E1 > E 
of one real variable with values in E. Functions f: E! + E* (admitting finite 
and infinite values) are said to be extended real. Thus f: E! > E may be real, 
extended real, complex, or vector valued. 

Operations in E* were defined in Chapter 4, 84. Recall, in particular, our 
conventions (2*) there. Due to them, addition, subtraction, and multiplication 
are always defined in E* (with sums and products possibly “unorthodox” ). 

To simplify formulations, we shall also adopt the convention that 


f(x) =0 unless defined otherwise. 


(“O” stands also for the zero-vector in E if E is a vector space.) Thus each 
function f is defined on all of E'. For convenience, we call f(x) “finite” if 
f(x) 4 £co (also if it is a vector). 


Definition 1. 


For each function f: E! > E, we define its derived function f': E' > E 
by setting, for every point p € FE}, 


t'(p) lim f(z) = SP) if this limit exists (finite or not); (1) 
op) = «2p L—p 
0, otherwise. 


Thus f’(p) is always defined. 
If the limit in (1) exists, we call it the derivative of f at p. 
If, in addition, this limit is finite, we say that f is differentiable at p. 
If this holds for each p in a set B C E!, we say that f has a deriva- 
tive (respectively, is differentiable) on B, and we call the function f’ the 
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derivative of f on B. 
If the limit in (1) is one sided (with x + p~ or x + p*), we call ita 
one-sided (left or right) derivative at p, denoted f’ or f!. 


Note that the formula f’(p) = 0 holds also if f has no derivative at p. On 
the other hand, f’(p) 4 0 implies that f’(p) is a genuine derivative. 
Definition 2. 

Given a function f: E' + E, we define its nth derived function (or derived 
function of order n), denoted f‘™: E! + E, by induction: 


fO =f, fetD = [fry nea, 1, Qaccss 


Thus f("+) is the derived function of f/™. By our conventions, f‘” is 
defined on all of E' for each n and each function f: E' > E. We have 
f© = f', and we write f” for f(), f’” for f@, etc. We say that f has n 
derivatives at a point p iff the limits 


fa) = 7G) 


lim 
xq xr-—q 
exist for all g in a neighborhood G, of p and for k = 0, 1, ..., m — 2, and also 
(n—1) _ £(n—1) 
fan fo) = FPO) 
xp L—D 


exists. If all these limits are finite, we say that f is n times differentiable on 
I; similarly for one-sided derivatives. 

It is an important fact that differentiability implies continuity. 
Theorem 1. Jf a function f: E! > E is differentiable at a point p € E, it is 
continuous at p, and f(p) is finite (even if E = E*). 
Proof. Setting Ax = x — pand Af = f(x) — f(p), we have the identity 


A 
Ye) -F@)=|G-(@-p)| tore ép. (2) 
By assumption, 
bee 2. Af 
f'(p) = Maen ne 


exists and is finite. Thus as x — p, the right side of (2) (hence the left side as 
well) tends to 0, so 


lim | f(x) — f(p)| = 0, or lim f(x) = f(p), 


xL—->>p 


lIf B is an interval, the derivative at its endpoints (if in B) need be one sided only, as 
x — p over B (see next). 
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Y 
y = fn(x) 


—4-" O|p an a4 24-7 
FIGURE 21 
proving continuity at p. 


Also, f(p) # too, for otherwise | f(x) — f(p)| = +00 for all x, and so 
|f(x) — f(p)| cannot tend to0. O 


Note 1. Similarly, the existence of a finite left (right) derivative at p implies 
left (right) continuity at p. The proof is the same. 


Note 2. The existence of an infinite derivative does not imply continuity, 
nor does it exclude it. For example, consider the two cases 


i. fe) = 7 with f(0) = 0, and 
(ii) fe) = ¥z. 


Give your comments for p = 0. 
Caution: A function may be continuous on E! without being differentiable 
anywhere (thus the converse to Theorem 1 fails). The first such function was 


indicated by Weierstrass. We give an example due to Olmsted (Advanced 
Calculus). 


Examples. 


(a) We first define a sequence of functions f,: E' ~ E' (n = 1, 2,...) as 
follows. For each k = 0, +1, +2, ..., let 


fa(z) =Oife=k-4-, and f,(¢) = 3-4" ifs =(k+4)-4". 


Between k-4~" and (k + $)-4~", fy is linear (see Figure 21), so it is 
continuous on EL}. The series 5> f, converges uniformly on E'. (Verify!) 
Let 


f = 2; Fn- 
n=1 


Then f is continuous on E! (why?), yet it is nowhere differentiable. 
To prove this fact, fix any p € E!. For each n, let 


In =p+dn, where d, =+4-""1, 
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choosing the sign of d, so that p and x, are in the same half of a “saw- 
tooth” in the graph of f,, (Figure 21). Then 


fn(@n) — fn(p) = Edn = +(Zn —p). (Why?) 


Also, 
tim(tn) — fm (p) = +dy ifm <n 


but vanishes form >n. (Why?) 
Thus, when computing f(z,) — f(p), we may replace 


f=) ture = > fx 
m=1 m=1 


Since 
fm(&n) — fm(P) 


In — Dp 


= form <1, 


the fraction 
f (zn) = (vp) 
Ln — Pp 
is an integer, odd if n is odd and even if n is even. Thus this fraction 


cannot tend to a finite limit as n —> oo, i.e., as dn = 47"~' > 0 and 
=p+d, —p. A fortiori, this applies to 


lm 162) —f@) 
Lp =p 


Thus f is not differentiable at any p. 


The expressions f(x) — f(p) and x—p, briefly denoted Af and Az, are called 
the increments of f and x (at p), respectively.2 We now show that for differ- 
entiable functions, Af and Az are “nearly proportional” when x approaches 
p; that is, 


Af 
he =c+06(z) 
with c constant and lim;-,, 6(“) = 0. 
Theorem 2. A function f: E' > E is differentiable at p, and f'(p) = c, - 
there is a finitec € E and a function 6: E' + E such that i (e\=s(p) = 
and such that 
Af =[e+6(x)|Ax for all x € E'. (3) 


? This notation is rather incomplete but convenient. One only has to remember that both 
Af and Ax depend on x and p. 
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Proof. If f is differentiable at p, put c= f’(p). Define 6(p) = 0 and 


(0) = 24 — 7'@) ore Zp. 


Then lim,z_,, 6(x) = f'(p) — f’(p) = 0 = 6(p). Also, (3) follows. 
Conversely, if (3) holds, then 


A 
=c+06(%) >cas x > p (since d(x) > 0). 
Thus by definition, 
: AS ! / oo: . 
c= Te = f'(p) and f’(p) = cis finite. 


Theorem 3 (chain rule). Let the functions g: E' + E' (real) and f: E1 > E 
(real or not) be differentiable at p and q, respectively, where q = g(p). Then 
the composite function h = f og is differentiable at p, and 


h'(p) = f'(q)9'(p)- 
Proof. Setting 
Ah = h(x) — h(p) = f(g(x)) — F(g(e)) = Fla(2)) -— FM), 


we must show that 


Ah 
lim 5 = fF @s9'P) # £00. 


Now as f is differentiable at q, Theorem 2 yields a function 6: E! + E such 
that lim,;-,, 6(a) = 6(q) = 0 and such that 


(Vy¥eE') fy) -f@=lf(at+oyiAy, Ay=y-4. 
Taking y = g(x), we get 


(Vee) f(g(x))— f(a) = [f'(@) + 46(9(x))][9(e) - 9(p)], 


where 
g(x) — g(p) = y—q = Ay and f(g(x)) — f(q) = Ah, 
as noted above. Hence 
RE = [F(a + 6(9(2))]- L2=8P) for alt 2 #p 
£ xL—Dp 


Let x — p. Then we obtain h’(p) = f’(q)g’(p), for, by the continuity of dog 
at p (Chapter 4, §2, Theorem 3), 


lim 8(g(x)) = (9(p)) = d(¢) = 0. 
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The proofs of the next two theorems are left to the reader. 


Theorem 4. Jf f, g, andh are real or complex and are differentiable at p, so 
are 


fears, and + 


(the latter if h(p) #0), and at the point p we have 

(i) (fio! =f 29’; 

(ii) (hf)’ =hf' +h'f; and 

wa (2) ft SRT 
i) (5) =e 
All this holds also if f and g are vector valued and h is scalar valued. It also 


applies to infinite (even one-sided) derivatives, except when the limits involved 
become indeterminate (Chapter 4, 84). 


Note 3. By induction, if f, g, and h are n times differentiable at a point 
p, so are f +g and hf, and, denoting by (2) the binomial coefficients, we have 


G*) toy =f™ 26> and 


ut) (Af) = (;) p(k) pln—k). 
i) (HM = (FAD 
Formula (ii*) is known as the Leibniz formula; its proof is analogous to that 
of the binomial theorem. It is symbolically written as (hf)(™ = (h+ f)”, with 
the last term interpreted accordingly.? 


Theorem 5 (componentwise differentiation). A function f: E' + E"(C”) is 
differentiable at p iff each of its n components (fi, ..-, fn) is, and then 


POO}. 7) => een 
k=1 


with €, as in Theorem 2 of Chapter 3, §81-3. 
In particular, a complex function f: E' > C is differentiable iff its real and 
imaginary parts are, and f' = fl, +i- fi, (Chapter 4, §3, Note 5). 


Examples (continued). 
(b) Consider the complex exponential 


f(z) =cosx +i-sinz = e™ (Chapter 4, §3). 


We assume the derivatives of cos x and sin z to be known (see Problem 8). 
By Theorem 5, we have 


f(x) = —sing +i-cosx = cos(x+ $m) +i-sin(x + $7) = (tt ant 


3In this connection, recall again the notation introduced in Chapter 4, §3 and also in 
footnote 1 of Chapter 3, 89 and footnote 1 of Chapter 4, §13. We shall use it throughout. 
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Hence by induction, 
f(a) = eletgnm)é n=1,2,.... (Verify!) 
(c) Define f: E1 > E® by 
f(z) =(1, cosa, sinz), «€ E'. 
Here Theorem 5 yields 


f'(p) =(0, —sinp, cosp), pe E’. 


For a fixed p = po, we may consider the line 
where 


This is, by definition, the tangent vector at po to the curve f[E*] in E°. 


More generally, if f: E' > E is differentiable at p and continuous on some 
globe about p, we define the tangent at p to the curve f|G>p] (in E) to be the 
line 

&= f(p)+t- f'n); 
f'(p) is its direction vector in EF, while t is the variable real parameter. For real 


functions f: E! + E', we usually consider not f[E*] but the curve y = f(x) 
in E?, i.e., the set 
{(a, y) | a f(z), LE E"}. 
The tangent to that curve at p is the line through (p, f(p)) with slope f’(p). 
In conclusion, let us note that differentiation (i.e., taking derivatives) is a 
local limit process at some point p. Hence (cf. Chapter 4, $1, Note 4) the 
existence and the value of f'(p) is not affected by restricting f to some globe 


G, about p or by arbitrarily redefining f outside Gy. For one-sided derivatives, 
we may replace G’, by its corresponding “half.” 


Problems on Derived Functions in One Variable 


1. Prove Theorems 4 and 5, including (i*) and (ii*). Do it for dot products 
as well. 


2. Verify Note 2. 
3. Verify Example (a). 
3’. Verify Example (b). 


4. Prove that if f has finite one-sided derivatives at p, it is continuous at p. 
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. Restate and prove Theorems 2 and 3 for one-sided derivatives. 


. Prove that if the functions f;: E' + E* (C) are differentiable at p, so 


is their product, and 


(fijo tm) = Soffa: fia fi fier +> Sm) at p. 


wl 


. A function f: EL! > E is said to satisfy a Lipschitz condition (L) of 


order a (a > 0) at p iff 
(45 >0) AK € EB’) (VzeG_,(9)) |f(2) — f()| < Kla — pl. 


Prove the following: 


(i) This implies continuity at p but not conversely; take 


f(z) = —_, fo) =0. 


= Par, 
[Hint: For the converse, start with Problem 14(iii) of Chapter 4, §2.] 

(ii) ZL of order a > 1 implies differentiability at p, with f’(p) = 0. 

(iii) Differentiability implies L of order 1, but not conversely. (‘Take 


f(z) =asin—, f(0) =0, p=0: 


then even one-sided derivatives fail to exist.) 


. Let 


{ (“) =sinige and g(x) = cosa. 
Show that f and g are differentiable on E!, with 
f'(p) = cosp and g'(p) = —sinp for each p € E'. 


Hence prove for n = 0, 1, 2,... that 
f™(p) = sin(p + =) and g\")(p) = cos(p + =). 


[Hint: Evaluate Af as in Example (d) of Chapter 4, §8. Then use the continuity of 
f and the formula 


To prove the latter, note that 
|sinz| < |z| < | tan 2], 


whence : 
= 
sinz ~ |cosz| 


Lx > 1; 


similarly for g.] 
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9. 


10. 


11. 


12. 


13. 


Prove that if f is differentiable at p then 


f'(p) = lim 


i.e., (Ve > 0) (J 


6 >0) (Vxe (p, p+4)) Vy € (p—4, p)) 
cr) — / 
L2-I0) _ pe] ce 
ry 
Disprove the converse by redefining f at p (note that the above limit 


does not involve f(p)). 
[Hint: If y< p< a then 


f(x) — fY) 2 a= Fo) _ 
al eae 


— — f'(v)| jos) _ 
ry cy 


<=? #'(p)| + Po" '(p)| 
y cy 


< fo te) - f'p)|+|SP= -F'@)| 59) 
&—p p-y 


Prove that if f is twice differentiable at p, then 
_ f(p+h) —2f(p) + flip —h) 
” __ 
ee ia 


Does the converse hold (cf. Problem 9)? 


# +00 


In Example (c), find the three coordinate equations of the tangent line 
at p= aT. 


Judging from Figure 22 in §2, discuss the existence, finiteness, and sign 
of the derivatives (or one-sided derivatives) of f at the points p; indi- 
cated. 


Let f: E” > E be linear, i.e., such that 
(Vz,y¢ E") (Va,be E') f(az+by) = af (Z) + Of (9). 


Prove that if g: E' > E” is differentiable at p, so is h = fog and 
h'(p) = f(9'(p)). 


[Hint: f is continuous since f(Z) = S°p_, tf (Ex). See Problem 5 in Chapter 3, 
§§4-6.] 


§2. Derivatives of Extended-Real Functions 


For a while (in §§2 and 3), we limit ourselves to extended-real functions. Below, 
f and g are real or extended real (f, g: E‘ + E*). We assume, however, that 
they are not constantly infinite on any interval (a, b), a < b. 
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Lemma 1. /f f'(p) > 0 at some p € E', then 
r<p<y 
implies 
f(a) < fp) < FY) 


for all x, y in a sufficiently small globe Gp(5) = (p— 6, p+6).' 
Similarly, if f'(p) <0, thenz <p<y implies f(x) > f(p) > f(y) fora, y 
in some G,(6). 
Proof. If f’(p) > 0, the “0” case in Definition 1 of §1, is excluded, so 
nN 
f'(p) = lim As =f. 


Hence we must also have Af/Azx > 0 for x in some G,(6). 
It follows that Af and Az have the same sign in G,(6); ie., 


f(x) — f(p) > Oif a > pand f(x) — f(p) < Oifu<p. 
(This implies f(p) 4 too. Why?) Hence 
c<p<y=> f(t) < fp) < fy), 


as claimed; similarly in case f’(p) < 0. 


Corollary 1. If f(p) is the maximum or minimum value of f(x) for x in some 
G,(6), then f'(p) = 0; t.e., f has a zero derivative, or none at all, at p. 


For, by Lemma 1, f’(p) 4 0 excludes a maximum or minimum at p. (Why?) 


Note 1. Thus f’(p) = 0 is a necessary condition for a local maximum or 
minimum at p. It is insufficient, however. For example, if f(x) = x3, f has no 
maxima or minima at all, yet f’(0) =0. For sufficient conditions, see §6. 

Figure 22 illustrates these facts at the points po, p3,..., p11. Note that in 
Figure 22, the isolated points P, Q, R belong to the graph. 

Geometrically, f’(p) = 0 means that the tangent at p is horizontal, or that 
a two-sided tangent does not exist at p. 


Theorem 1. Let f: E! > E* be relatively continuous on an interval [a, b}, 
with f’ £0 on (a, b). Then f is strictly monotone on [a, b], and f' is sign- 
constant there (possibly 0 at a and b), with f’ > 0 if ft, and f’ <0 if fi. 


Proof. By Theorem 2 of Chapter 4, 88, f attains a least value m, and a largest 
value M, at some points of [a, b]. However, neither can occur at an interior 
point p € (a, b), for, by Corollary 1, this would imply f’(p) = 0, contrary to 
our assumption. 


! This does not mean that f is monotone on any Gp (see Problem 6). We shall only say 
in such cases that f increases at the point p. 
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Y 

aN 

y = f(z) 
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FIGURE 22 


Thus M = f(a) or M = f(b); for the moment we assume M = f(b) and 
m = f(a). We must have m < M, form = M would make f constant on |[a, 5], 
implying f’ = 0. Thus m = f(a) < f(b) =M. 

Now let a < x < y < b. Applying the previous argument to each of the 
intervals [a, x], [a, y], [z, y], and [a, 6] (now using that m = f(a) < f(b) = M), 
we find that 


f(a) < f(x) < fly) < f(b). (Why?) 


Thus a < x < y < b implies f(x) < f(y); ie., f increases on [a, b]. Hence 
f’ cannot be negative at any p € |a, 6], for, otherwise, by Lemma 1, f would 
decrease at p. Thus f’ > 0 on [a, 0]. 


In the case M = f(a) > f(b) =m, we would obtain f’ < 0. 


Caution: The function f may increase or decrease at p even if f’(p) = 0. 
See Note 1. 


Corollary 2 (Rolle’s theorem). If f: E' + E* is relatively continuous on 
[a, b] and if f(a) = f(b), then f’(p) = 0 for at least one interior point p € (a, b). 
For, if f’ 4 0 on all of (a, b), then by Theorem 1, f would be strictly 
monotone on [a, 6], so the equality f(a) = f(b) would be impossible. 
Figure 22 illustrates this on the intervals [p2, pa] and [pa, pe], with f’(p3) = 
f' (ps) = 0. A discontinuity at 0 causes an apparent failure on [0, po}. 


Note 2. Theorem 1 and Corollary 2 hold even if f(a) and f(b) are infinite, if 
continuity is interpreted in the sense of the metric p’ of Problem 5 in Chapter 3, 
811. (Weierstrass’ Theorem 2 of Chapter 4, §8 applies to (E*, p’), with the 
same proof.) 

Theorem 2 (Cauchy’s law of the mean). Let the functions f, g: E1 > E* be 
relatively continuous and finite on [a, b| and have derivatives on (a, b), with f' 
and g' never both infinite at the same point p € (a, b). Then 


9 (DIF) — Fla)] = F@Ig9(®) — g(@)] for at least one q € (a,b). (1) 


262 Chapter 5. Differentiation and Antidifferentiation 


Proof. Let A = f(b)— f(a) and B = g(b)—g(a). We must show that Ag'(q) = 
B f'(q) for some q € (a, b). For this purpose, consider the function h = Ag—Bf. 
It is relatively continuous and finite on [a, b], as are g and f. Also, 


h(a) = f(b)g(a) — 9(b) f(a) = h(b). (Verify!) 


Thus by Corollary 2, h’(q) = 0 for some q € (a, b). Here, by Theorem 4 of 
$1, h’ = (Ag — Bf)’ = Ag’ — Bf’. (This is legitimate, for, by assumption, f’ 
and g’ never both become infinite, so no indeterminate limits occur.) Thus 
h'(q) = Ag'(q) — Bf’(q) = 0, and (1) follows. 


Corollary 3 (Lagrange’s law of the mean). If f: E' > E? is relatively con- 
tinuous on |a, b] with a derivative on (a, b), then 


f(b) — f(a) = f'(q)(b— a) for at least one q € (a, b). (2) 


Proof. Take g(x) = x in Theorem 2, so g’ = 1 on E!?. 


Note 3. Geometrically, 
f(b) — F(a) ‘\ 
b-—a 


is the slope of the secant through 
(a, f(a)) and (0, f(b)), and f"(q) is 
the slope of the tangent line at q. | 
Thus Corollary 3 states that the se- | 
cant is parallel to the tangent at some 
intermediate point q; see Figure 23. 
Theorem 2 states the same for curves 
given parametrically: x = f(t), y = g(t). 


Corollary 4. Let f be as in Corollary 3. Then 
(i) f is constant on [a, 6] iff f’ =0 on (a, b); 
(ii) ft on [a, b] iff f’ > 0 on (a,b); and 

(iii) fl on [a,b] iff f’ <0 on (a,b). 


FIGURE 23 


Proof. Let f’ = 0on (a, b). Ifa< a <y< b, apply Corollary 3 to the interval 
[x, y] to obtain 


f(y) — f(z) = f'(a)(y — 2) for some q € (a, b) and f’(q) = 0. 


Thus f(y) — f(z) =0 for zx, y € |a, b], so f is constant. 
The rest is left to the reader. OU 
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Theorem 8 (inverse functions). Let f: E! + E' be relatively continuous and 
strictly monotone on an interval I C E'. Let f'(p) 4 0 at some interior 
point p € I. Then the inverse function g = f— (with f restricted to I) has a 
derivative at q = f(p), and 


(Uf f'(p) = +00, then g'(q) = 0.) 
Proof. By Theorem 3 of Chapter 4, 89, g = f 1 is strictly monotone and 
relatively continuous on f [J], itself an interval. If p is interior to J, then g = f(p) 
is interior to f [I]. (Why?) 

Now if y € f[J], we set 


Ag = 9(y) — 9(a), Ay=y—9, = f(y) = gly), and f(x) =y 
and obtain 


Ag _ o(y)~9(@)_ tp _ Ary 
Ay y-4 Fa) — Fe) ap 77? 


Now if y > q, the continuity of g at q yields g(y) > g(q); i-e., x > p. Also, 
x #p iff y ~q, for f and g are one-to-one functions. Thus we may substitute 
y = f(x) or x = g(y) to get 

NG 1 1 5 


ee ee ee = = : 
Ha= tmx, = AF Tae Fo 


where we use the convention + = 0 if f’(p)=0o0. O 


Examples. 
(A) Let 
f(x) = log, |z| with f(0) =0. 


Let p > 0. Then (Vx > 0) 
Af = f(z) — f(p) = log, « — log, p = log, (x/p) 


- A 
= log, p+(t—p) = log, (1 + —). 
Pp Pp 


Thus 


— = log 


Bb as 2) 


2 More precisely, we are replacing the x by g(y) in (x — p)/[f(x) — f(p)] by Corollary 2 of 
Chapter 4, §2 to obtain g’(q). The steps in (2’) should be reversed. 
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Now let z = Aaz/p. (Why is this substitution admissible?) Then using 
the formula 


lim(1+z)!/* =e (see Chapter 4, §2, Example (C)) 


z—0 


and the continuity of the log and power functions, we obtain 


A 1 
f'(p) = lim 2D adie log, [(1 + z)'/7]}/? = log, e'/? = — log, e. 
z—>p AX z—0 Pp 


The same formula results also if p < 0, i-e., |p| = —p. At p= 0, f has 
one-sided derivatives (+00) only (verify!), so f’(0) = 0 by Definition 1 
in §1. 


(B) The inverse of the log, function is the exponential g: E! + E+, with 
gly) =a" (a>0, a# 1). 


By Theorem 3, we have 


VqeE') g'(qQ= P=9@O =e 
( ) g@ Fat) (q) 
Thus 
ee 
g(a) = = log, € ~ log,e log,e 
Symbolically, 
ig Wabi GS" = ating (3) 
Sa Zea ; ~ logge ; 


In particular, if a = e, we have log, a = 1 and log, x = Inz; hence 


(in |g@|) = - (x #0) and (e*)'’=e” (2 € E'). (4) 


(C) The power function g: (0, too) 4 E? is given by 
g(x) = x" = exp(a-Inz) for x > 0 and fixed a € E’. 


By the chain rule (§1, Theorem 3), we obtain 


/ a a a a-1 
xz) =exp(a-Inxz)-—=a2"°-—=a-u2 
gfe) = exp(a-Inn)- 4 = 0%. 


Thus we have the symbolic formula 


(2*)' =a-a2*~' for x > 0 and fixed a € E’. (5) 
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Theorem 4 (Darboux). If f: E' + E* is relatively continuous and has a 
derivative on an interval I, then f’ has the Darboux property (Chapter 4, §9) 
on I. 


Proof. Let p,q € I and f'(p) <c< f’(q). Put g(x) = f(z) — cx. Assume 
g’ #0 on (p, qg) and find a contradiction to Theorem 1. Details are left to the 
reader. 


Problems on Derivatives of Extended-Real Functions 


1. Complete the missing details in the proof of Theorems 1, 2, and 4, 
Corollary 4, and Lemma 1. 


[Hint for converse to Corollary 4(ii): Use Lemma 1 for an indirect proof.| 
2. Do cases p < 0 in Example (A). 


3. Show that Theorems 1, 2, and 4 and Corollaries 2 to 4 hold also if f 
is discontinuous at a and b but f(a*) and f(b) exist and are finite. 
(In Corollary 2, assume also f(at) = f(b~); in Theorems 1 and 4 and 
Corollary 2, finiteness is unnecessary. ) 

[Hint: Redefine f(a) and f(b).] 

4. Under the assumptions of Corollary 3, show that f’ cannot stay infinite 
on any interval (p, gq), a<p<q<ob. 
[Hint: Apply Corollary 3 to the interval [p, q].] 


5. Justify footnote 1. 
[Hint: Let 
f(a) = 2+ 22 sin = with f(0) =0. 


At 0, find f’ from Definition 1 in §1. Use also Problem 8 of §1. Show that f is not 
monotone on any Go(06).] 

6. Show that f’ need not be continuous or bounded on [a, b] (under the 
standard metric), even if f is differentiable there. 
[Hint: Take f as in Problem 5.] 


7. With f as in Corollaries 3 and 4, prove that if f’ > 0 (f’ < 0) on (a, b) 
and if f’ is not constantly 0 on any subinterval (p, q) 4 0, then f is 
strictly monotone on |a, b]. 


8. Let x = f(t), y = g(t), where t varies over an open interval J C E?, de- 
fine a curve in E? parametrically. Prove that if f and g have derivatives 
on I and f’ 4 0, then the function h = f~' has a derivative on f[J], 
and the slope of the tangent to the curve at tg equals g’(to)/f’(to). 
[Hint: The word “curve” implies that f and g are continuous on J (Chapter 4, §10), 
so Theorems 1 and 3 apply, and h = f~! is a function. Also, y = g(h(x)). Use 
Theorem 3 of §1.] 

9. Prove that if f is continuous and has a derivative on (a, b) and if f’ 
has a finite or infinite (even one-sided) limit at some p € (a, b), then 
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this limit equals f’(p). Deduce that f’ is continuous at p if f’(p~) and 
f'(pt) exist. 
[Hint: By Corollary 3, for each x € (a, b), there is some qz between p and x such 


that 
A 
(qo) = SE > FQ) a8. 2 p. 
x 


Set y = dx, so limy+p f'(y) = f'(p).] 
10. From Theorem 3 and Problem 8 in §1, deduce the differentiation formu- 
las 
(arcsin x)’ = i (arccos x)’ = ete (arctan xz)’ = a 
1+? 


JI — x2’ V1 — x?’ 


11. Prove that if f has a derivative at p, then f(p) is finite, provided f is 
not constantly infinite on any interval (p, q) or (q,p), p # q. 
[Hint: If f(p) = +oo, each Gp has points at which ai = +00, as well as those x 
with si = —oo.] 


§3. L’Hopital’s Rule 


We shall now prove a useful rule for resolving indeterminate limits. Below, G., 
denotes a deleted globe G_,(6) in E', or one about +00 of the form (a, +00) 
or (—oo, a). For one-sided limits, replace G_, by its appropriate “half.” 
Theorem 1 (L’Ho6pital’s rule). Let f, g: E' > E* be differentiable on Guy, 
with g' #0 there. If |f(x)| and |g(x)| tend both to +o0,' or both to 0, as x 4 p 
and if 
/ 
im f(z) =r efists in E*, 
wp g' (x) 


then also 


similarly for x > pt orx—p-. 


Proof. It suffices to consider left and right limits. Both combined then yield 
the two-sided limit. 
First, let —oo < p < +00, 


= (jiile). 


| ere an LO) 
anor EN ip Oe = too and Oo aa) 


! This includes the cases f(x) + too and g(x) + +oo. 
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Then given ¢ > 0, we can fix a > p (a € G_,) such that 


f'(x) 
g'(x) 


—r|<e, for all x in the interval (p, a). (1) 


Now apply Cauchy’s law of the mean (§2, Theorem 2) to each interval [x, a], 
p<a«<a. This yields, for each such x, some gq € (x, a) with 


I (DIF (@) — fla] = f@Ig9(@) — 9(@)].- 


As g’ £0 (by assumption), g(x) # g(a) by Theorem 1, §2, so we may divide 
to obtain 


= , wherep<2<q<a. 


fn) = fla) 
g(x) — g(a) “* 
or, setting 
P(e) = Le LO/FO) 
1 — g(a)/g(x)’ 
we have 
f(x) | v)—r or all x inside a 
Gia) F(®)—"| <¢ for all « inside (p, a). (2) 


As |f(a)| and |g(x)| > +oo (by assumption), we have F(x) + 1 asx — pt. 
Hence by rules for right limits, there is 6 € (p, a) such that for all x € (p, 0), 
both |F(x) — 1] < ¢ and F(x) > 5. (Why?) For such z, formula (2) holds as 
well. Also, 


1 
—— < 2 and |r—rF(x)| = |r| |1— F(2)| < re. 
Fo | (x)| = Irl| ( 


Combining this with (2), we have for x € (p, 6) 


f(x) 
<2 Ty Far tr rF(2)| 
< 2e(1+ |r|). 


Thus, given ¢ > 0, we found b > p such that 
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As ¢€ is arbitrary, we have lim f(z) =r, as claimed. 
xr—pt g(x) 


The case lim,_,,+ f(x) = lim,_,,+ g(v) = 0 is simpler. As before, we obtain 


-r| ae 


| f(x) — f(a) 
g(x) — g(a) 
Here we may as well replace “a” by any y € (p, a). Keeping y fixed, let 2 — p*. 
Then f(x) > 0 and g(x) > 0, so we get 


ae | <e for any y € (p, a). 


f(y) 


As € is arbitrary, this implies lim, i" =r. Thus the case x > pt is settled 
for a finite r. vet oly 


The cases r = too and x —> p™ are analogous, and we leave them to the 
reader. 


/ 
Note 1. lim f(z) may exist even if lim ie) does not. For example, take 
g(x) g(x) 
f(x) =2x+sinz and g(x) =z. 
Then : 
lim fx) = lim (1 + =") =1 (why?), 
xr—>+00 g xr) x~—>+00 Ob 
but ; 
F(@) =1+cosz 
g' (x) 


does not tend to any limit as x + +oo. 
Note 2. The rule fails if the required assumptions are not satisfied, e.g., if 
g’ has zero values in each G—p; see Problem 4 below. 


Often it is useful to combine L’HO6pital’s rule with some known limit formu- 
las, such as 


lim (1 + z)'/* —e or lim a (see §1, Problem 8). 
Z> 


«70 sin” 
Examples. 
l l : 
(a) lim “f= lim a = lim —=0 
Z>+co 2 tr—+oo 1 LZ>+00 @ 
In(1 1/(1 
(b) lim ae) = hh a, = 1, 
x—0 a. xz—0 1 
. «e-sina . L—cosz . sina 1... sing 1 
(c) lim —_,— = lim —_,— = lim = — lim —— 
xz—0 45 x—0 372 x—0 62x 6 z->0 6 


(Here we had to apply L’Hopital’s rule repeatedly.) 
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(d) Consider 
e- 1/a 
lim 
x—0t x 


Taking derivatives (even n times), one gets 
eo l/& 
aS amie 2 1, 2, 3, ... (always indeterminate!). 
Thus the rule gives no results. In this case, however, a simple device helps 
(see Problem 5 below). 


1/n 0 


does not have the form 5 or 2, so the rule does not apply 


(e) limn+on 7 


directly. Instead we compute 


lim Inn¥/" = lim —" =0 (Example (a)). 
noo no mn 


Hence 


1/n 


ni/” — exp(Inn/”) > exp(0) = e° = 1 


by the continuity of exponential functions. The answer is then 1. 


Problems on L’H6pital’s Rule 


Elementary differentiation formulas are assumed known. 

1. Complete the proof of L’Hopital’s rule. Verify that the differentiability 
assumption may be replaced by continuity plus existence of finite or 
infinite (but not both together infinite) derivatives f’ and g’ on Guy 
(same proof). 


2. Show that the rule fails for complex functions. See, however, Problems 3, 
7, and 8. 
[Hint: Take p = 0 with 


F 1 1 
f(x) =2 and g(x) =2+2et/™ = 0-40 (cos 5 +i-sin 5), 


Then 
f(a) One 


lim ——~ = 1, th h lim ——— = = 0. 
e30 g(a) 40 g(a) 2-40 g(a) 


Indeed, g’(x) — 1 = (2x — 2i/x)ei/?* , (Verify!) Hence 
lg/(@)| +1 > [2x — 2é/a| (for |e/*"| = 1), 
so 5 
lo'(@)| > 1+ 2. (why?) 


Deduce that 
x 


7a! $I 
g'(a)|~ 12-2 


| +0. 
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. Find lm 
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. Prove the “simplified rule of L’Hopital” for real or complex functions 


(also for vector-valued f and scalar-valued g): If f and g are differen- 
tiable at p, with g'(p) #0 and f(p) = g(p) = 0, then 
f(a) _ fp) 


zp g(t) g'(p) 


[Hint: 
f(z) _ f(v)—~f@) _ Af /Ag _, f'@) 
g(z) g(t)—g(p) Ax/ Ax — g'(p) 
. Why does lim f(z) not exist, though lim f (2) does, in the fol- 
L—>+00 g(x) w—+co g(x) 


lowing example? Verify and explain. 
f(x) =e"**(cosx+2sinz), g(x)=e *(cosx+sinz). 


[Hint: g’ vanishes many times in each Gioo. Use the Darboux property for the 
proof] 


el/« 


20+ x 
Hint: Substitute z = + 4 +oo. Then use the rule. 
x 


. Verify that the assumptions of L’H6pital’s rule hold, and find the fol- 


lowing limits. 


(a) lim —" —* 

z+0 Infe—x)+2—-—1 
£_ pt _9 

(b) lim ——“__".. 
x—0 xv — sinzv 

(c) lim G+a)¥* -e, 
x—0 Mi : 

(a) lim (ene), > 05 

(e) im (e-"in2), q > 0: 

f) li me 

(f) oe” 

(g) lim (eta), a> 1,¢>0; 


(h) lim e — cotan? a 


xz—0 x? 


1/lInaz 
(i) lim (= — arctan x) ‘ 


L—+00 


(j) lim 


x0 


(2) 1/(1—cos x) 
; . 
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7. Prove L’H6pital’s rule for f: E1 > E” (C) and g: E! > E}, with 


lim |f(x)| = 0 = lim |g(z)|, p € B* andre E”, 
kp «=p 


leaving the other assumptions unchanged. 


Hint: Apply the rule to the components of £ respectively, to £ and (£ ; 
g I/ re I im 


8. Let f and g be complex and differentiable on G_», p € E'. Let 
lim f(z) = lim g(x) =0, lim f’(x) = gq, and lim g(x) =r £0. 
«Lp xL—>p xL—>p 


wp 
Prove that lim i) = q 
ap g(a) oT 
[Hint: 
f(z) _ f(z) / g(2) 
g(@) ap] 2-p 


Apply Problem 7 to find 


*9. Do Problem 8 for f: E' > C" and g: E! 3 C. 


§4. Complex and Vector-Valued Functions on E} 


The theorems of §82-3 fail for complex and vector-valued functions (see Prob- 
lem 3 below and Problem 2 in §3). However, some analogues hold. In a sense, 
they even are stronger, for, unlike the previous theorems, they do not require 
the existence of a derivative on an entire interval I C E', but only on I — Q, 
where Q is a countable set, i.e., one contained in the range of a sequence, 
Q C {pm}. (We henceforth presuppose §9 of Chapter 1.) 

In the following theorem, due to N. Bourbaki,! g: E! > E* is extended real 
while f may also be complex or vector valued. We call it the finite increments 
law since it deals with “finite increments” f(b)— f(a) and g(b)—g(a). Roughly, 
it states that | f’| < g’ implies a similar inequality for increments. 


Theorem 1 (finite increments law). Let f: E’ + E and g: E' + E* be 
relatively continuous and finite on a closed interval I = [a, b] C E*, and have 
derivatives? with |f'| < g', on I—Q where Q C {pj, po, ---; Pm, -.-}. Then 


|f(0) — Fla@)| < g(6) — g(a). (1) 


| This is the pen name of a famous school of twentieth-century French mathematicians. 
2 Actually, right derivatives suffice, as will follow from the proof. (Left derivatives suffice 
as well.) 
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The proof is somewhat laborious, but worthwhile. (At a first reading, one 
may omit it, however.) We outline some preliminary ideas. 

Given any x € J, suppose first that 2 > p,, for at least one p,, € Q. In this 
case, we put 


n= > 


Pm<x 


here the summation is only over those m for which p,, < x. If, however, there 
are NO Pm € Q with py < x, we put Q(x) = 0. Thus Q(z) is defined for 
all x € I. It gives an idea as to “how many” p,, (at which f may have no 
derivative) precede x. Note that x < y implies Q(x) < Q(y). (Why?) Also, 


Q(x) < 3 a-™ = 1, 
m=1 
Our plan is as follows. To prove (1), it suffices to show that for some fixed 
K € E', we have 
(Ve>0) |f()— fl@)l < 9) - g(a) + Ke, 
for then, letting « — 0, we obtain (1). We choose 
Kk =b-—a+Q(b), with Q(z) as above. 
Temporarily fixing ¢ > 0, let us call a point r € I “good” iff 
lf(r) — F(a)| < g(r) — gla) + [r -— a+ Q(rle (2) 


and “bad” otherwise. We shall show that b is “good.” First, we prove a lemma. 


Lemma 1. Every “good” point r € I (r < b) is followed by a whole interval 
(r,s), r<s <b, consisting of “good” points only. 


Proof. First let r ¢ Q, so by assumption, f and g have derivatives at r, with 
If'(r)| <9'(r). 


Suppose g/(r) < +00. Then (treating g’ as a right derivative) we can find s > r 
(s <b) such that, for all x in the interval (r, s), 


(why?); 
similarly for f. Multiplying by x — r, we get 
Faq fr) =F e-h) =(e=9) 


lg(z) — g(r) — g'(r)(@—1)| < (@ =r) 


and 


rl 


D1 mM wl] 
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and hence by the triangle inequality (explain!), 


F(x) — f(r) Sf" @)|\(@ — 7) + (@ =r) 


Nl 


and 


q(r)(a—r) + (@—r)= < g(x) — g(r) + (a@—re. 


2 
Combining this with | f’(r)| < g’(r), we obtain 
|f(x) — f(r)| < g(x) — g(r) + (a — r)e whenever r < xz < s. (3) 
Now as r is “good,” it satisfies (2); hence, certainly, as Q(r) < Q(z), 
|f(r) — f(a)| < g(r) — g(a) + (r — a)e + Q(ax)e whenever r < x < s. 
Adding this to (3) and using the triangle inequality again, we have 
If(@) — F(a)| S$ g(@) — g(a) + [@ — a + Q(a)Je for all x € (7, 8). 


By definition, this shows that each x € (r, s) is “good,” as claimed. Thus 
the lemma is proved for the case r € I — Q, with g’(r) < +co. 


The cases g'(r) = +00 and r € Q are left as Problems 1 and 2. 


We now return to Theorem 1. 


Proof of Theorem 1. Seeking a contradiction, suppose b is “bad,” and let 
B#Q be the set of all “bad” points in [a, b]. Let 


r=inf B, ré|a, dj. 
Then the interval [a, 7) can contain only “good” points, i.e., points x such that 
|f(x) — fla)| < g(@) — g(a) + [a — a+ Q(a)Ie. 
As x <r implies Q(x) < 
|f(x) — f(@)| S$ g(@) — g(a) + [w@-a+ Q(r)Je for alle € [a,r). (A) 


Note that [a,r) 4 0, for by (2), @ is certainly “good” (why?), and so 
Lemma 1 yields a whole interval |a, s) of “good” points contained in [a, r). 


Q(r), we have 


Letting x — r in (4) and using the continuity of f at r, we obtain (2). Thus 
r is “good” itself. Then, however, Lemma 1 yields a new interval (r, q) of 
“good” points. Hence [a, g) has no “bad” points, and so q is a lower bound of 
the set B of “bad” points in I, contrary to gq > r = glb B. This contradiction 
shows that b must be “good,” i.e 


f(b) — F(a)| < g(b) — g(a) + [b—a + Q()Ie. 


Now, letting « > 0, we obtain formula (1), and all is proved. 
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Corollary 1. If f: E! > E is relatively continuous and finite on I = [a, b] C 
E', and has a derivative on I — Q, then there is a real M such that 


f(b) — fla)| < M(b— a) anaes Ae Me (5) 


Proof. Let 


Mo = sup |f'(é)|- 
teI—O 


If Mp < +00, put M = Mo > |f’| on I—Q, and take g(x) = Mz in Theorem 1. 
Then g’ = M > |f’| on I—Q, so formula (1) yields (5) since 


g(b) — g(a) = Mb—- Ma= M(b—-a). 
If, however, Mp = +o0, let 


= BRL), 


Then (5) clearly is true. Thus the required M exists always.? 


Corollary 2. Let f be as in Corollary 1. Then f is constant on I iff f' = 0 
on I-qQ. 
Proof. If f’ = 0 on J —Q, then M = 0 in Corollary 1, so Corollary 1 yields, 
for any subinterval [a, x] (x € I), |f(x) — f(a)| < 0; ie., f(x) = f(a) for all 
x € JI. Thus f is constant on I. 

Conversely, if so, then f’ = 0, even on all of J. 


Corollary 3. Let f,g: E' > E be relatively continuous and finite on I = 
[a, b], and differentiable on I— Q. Then f —g is constant on I iff f’ = g' on 
I-Q. 


Proof. Apply Corollary 2 to the function f — g. 


We can now also strengthen parts (ii) and (iii) of Corollary 4 in 82. 
Theorem 2. Let f be real and have the properties stated in Corollary 1. Then 

(i) ft on I =[a, }] iff f’ > 0 on I —Q; and 

(ii) fl on I iff f’ <0 onI-Q. 
Proof. Let f’ >0 on J—Q. Fix any 2, y € I (x < y) and define g(t) = 0 on 
E!. Then |g’| =0 < f’ on J—Q. Thus g and f satisfy Theorem 1 (with their 
roles reversed) on I, and certainly on the subinterval [x, y]. Thus we have 

f(y) — f(@) = |o(y) — 9@)| = 0, Le, Fy) = f(@) whenever y > x in J, 

so ft on I. 


3 Note that M as defined here depends on a and b. So does Mo. 
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Conversely, if ff on I, then for every p € I, we must have f’(p) > 0, for 
otherwise, by Lemma 1 of 82, f would decrease at p. Thus f’ > 0, even on ail 


of I, and (i) is proved. Assertion (ii) is proved similarly. O 


Problems on Complex and Vector-Valued Functions on E! 


i; 


Do the case g'(r) = +00 in Lemma 1. 
[Hint: Show that there is s > r with 


g(x) — g(r) = (lf (r)| + 1)(@— 1) = | F(x) — f(r)| for x € (r, 8). 


Such x are “good.” | 


. Do the case r = p, € Q in Lemma 1. 


[Hint: Show by continuity that there is s > r such that (Va € (r, s)) 
€ € 
f(z) — f(r)| < pet and |g(x) — g(r)| < dai 
Show that all such x are “good” since x > r = pn implies 


27" + Q(r) < Q(x). (Why?) 


. Show that Corollary 3 in §2 (hence also Theorem 2 in §2) fails for com- 


plex functions. 
[Hint: Let f(x) = e** =cosz+i-sinz. Verify that |f’| = 1 yet f(27) — f(0) = 01] 


(i) Verify that all propositions of §4 hold also if f’ and g’ are only 
right derivatives on I — Q. 
(ii) Do the same for left derivatives. (See footnote 2.) 


(i) Prove that if f: E1 > E is continuous and finite on I = (a, b) and 
differentiable on J — Q, and if 


sup _|f’(t)| < +o, 
tEI—Q 


then f is uniformly continuous on I. 
(ii) Moreover, if FE is complete (e.g., E = E”), then f(a*) and f(b) 
exist and are finite. 


[Hints: (i) Use Corollary 1. (ii) See the “hint” to Problem 11 (iii) of Chapter 4, §8.] 


. Prove that if f is as in Theorem 2, with f’ > 0 on I—Q and f’ > 0 


at some p € I, then f(a) < f(b). Do it also with f’ treated as a right 
derivative (see Problem 4). 


. Let f, g: E' — E' be relatively continuous on I = [a, b] and have right 


derivatives f, and g'‘, (finite or infinite, but not both infinite) on I—Q. 
(i) Prove that if 


mg < fi < Mg onI-Q 
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for some fixed m, M € E?, then 


mlg(b) — 9(@)] < F(®) — Fa) < M[9(6) — g(a). 
[Hint: Apply Theorem 2 and Problem 4 to each of Mg — f and f — mqg.] 
(ii) Hence prove that 


mo(b— a) < f(b) — fla) < Mo(b— a), 
where 
mo = inf f, [I — Q] and Mo = sup f, [I — Q] in E*. 
[Hint: Take g(x) = 2 if mo € E! or Mo € E!. The infinite case is simple.] 


8. (i) Let f: (a, b) > E be finite, continuous, with a right derivative on 
(a, b). Prove that q= lim. fi. (x) exists (finite) iff 
ra 


f(a) — FY) 


i.e., iff 


(Ve >0) (Ac >a) (Va, y € (a,c) | x Fy) ee 26 
(Hints: If so, let y > 2+ (keeping x fixed) to obtain 
(Vx (a,c)) |fi(%)—a|<e. (Why?) 


Conversely, if lim f{ (x) =q, then 
zat 


(Ve >0) Gc>a) (VtE(a,c)) |fL@—-al<e. 
Put 
M= sup [fi,(t)—a|<e (why <e?) 
a<t<c 
and 
Apply Corollary 1 and Problem 4 to h on the interval [x, y] C (a, c), to get 
If) — f(@) -— y-a)al < MYy— 2) <e(y— 2). 
Proceed.] 
(ii) Prove similar statements for the cases gq = too and x > b-. 


[Hint: In case g = too, use Problem 7(ii) instead of Corollary 1.] 


9. From Problem 8 deduce that if f is as indicated and if f! is left contin- 
uous at some p € (a, b), then f also has a left derivative at p. 
If f!. is also right continuous at p, then f’(p) = fl (p) = f’(p). 
[Hint: Apply Problem 8 to (a, p) and (p, b).] 
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10. 


11. 


12. 


13. 


14. 


In Problem 8, prove that if, in addition, E is complete and if 
q = lim, fi,(x) #00 (Finite), 
then f(at) 4 oo exists, and 
fw) — flat) _ 


similarly in case lim,_,,- fi. (a) =r. 

If both exist, set f(a) = f(at) and f(b) = f(b~). Show that then f 
becomes relatively continuous on [a, b], with f(a) = q and f! (b) =r. 
(Hint: If 

im, fi (x) =4 4 £00, 
then f‘ is bounded on some subinterval (a, c), a < c < b (why?), so f is uniformly 


continuous on (a, c), by Problem 5, and f(at) exists. Let y > at, as in the hint to 
Problem 8.] 


Do Problem 9 in §2 for complex and vector-valued functions. 
[Hint: Use Corollary 1 of §4.] 


Continuing Problem 7, show that the equalities 
_ f()- fla) 
b-—a 


hold iff f is linear, i.e., f(x) = ex +d for some c,d € E', and then 
e= i= MM, 


Let f: E' >C be as in Corollary 1, with f 40 on J. Let g be the real 
part of f’/f. 
(i) Prove that |f|t on J iffg >OonI-Q. 


(ii) Extend Problem 4 to this result. 


=M 


Define f: E! > C by 
1 1 
re/® = x? (cos = +%-sin -) if x > 0, and 
f(z) = x x 
0 ifx <0. 


Show that f is differentiable on J = (—1, 1), yet f’|I] is not a convex 
set in E? = C (thus there is no analogue to Theorem 4 of §2). 
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§5. Antiderivatives (Primitives, Integrals) 


Given f: E! > E, we often have to find a function F such that F’ = f on J, 
or at least on J — Q.! We also require F to be relatively continuous and finite 
on I. This process is called antidifferentiation or integration. 
Definition 1. 
We call F: E! > E a primitive, or antiderivative, or an indefinite inte- 
gral, of f on I iff 
(i) F is relatively continuous and finite on J, and 
(ii) F is differentiable, with F’ = f, on I — Q at least. 


We then write 
F= {ff or P(e) = f f(a) de, on J. 


(The latter is classical notation.) 

If such an F’ exists (which is not always the case), we shall say that 
J f exists on I, or that f has a primitive (or antiderivative) on I, or that 
f is primitively integrable (briefly integrable) on I. 

If F’ = f onaset BCI, we say that [ f is exact on B and call F an 
exact primitive on B. Thus if Q=0, f f is exact on all of I. 


Note 1. Clearly, if F’ = f, then also (F' +c)! = f for a finite constant 
c. Thus the notation F = ff is rather incomplete; it means that F' is one 
of many primitives. We now show that all of them have the form F' + ¢ (or 
Jfto). 
Theorem 1. Jf F andG are primitive to f on I, then G—F is constant on I. 


Proof. By assumption, Ff’ and G are relatively continuous and finite on J; 
hence so is G— F.. Also, F’ = f on JT—Q and G’ = f on I— P. (Q and P are 
countable, but possibly Q # P.) 

Hence both F’ and G’ equal f on I—S, where S = PUQ, and S is countable 
itself by Theorem 2 of Chapter 1, 89. 

Thus by Corollary 3 in §4, F’ = G’ on I — S implies G — F = c (constant) 
on each |x, y] C I; hence G— F =c (or G=F+4+c) onl. 


Definition 2. 
If F = { f on J and if a, bE I (where a < b or b <a), we define 


b 


b b 
/ j= / f(x) dx = F(b) — F(a), also written F(x)} . (1) 


a 


lIn this section, Q, P, and S shall denote countable sets, F’, G’, and H’ are finite 
derivatives, and I is a finite or infinite nondegenerate interval in E!. 
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This expression is called the definite integral of f froma to b.? 


The definite integral of f from a to b is independent of the particular choice 
of the primitive F' for f, and thus unambiguous, for if G is another primitive, 
Theorem 1 yields G = F'+ c, so 


G(b) — G(a) = F(b) +c — [F(a) +¢] = F(b) — F(a), 


and it does not matter whether we take F' or G. 
Note that L | (2) da, oF L f, is a constant in the range space E (a vector 


if f is vector valued). The “x” in i f(x) dx is a “dummy variable” only, and 
it may be replaced by any other letter. Thus 


b b 
/ f(a) de = / f(y) dy = F(®) — F(a). 


On the other hand, the indefinite integral is a function: F: E' > E. 


Note 2. We may, however, vary a or 6 (or both) in (1). Thus, keeping a 
fixed and varying b, we can define a function 


G(t) - [r= Fw Pa), €27: 


Then G’ = F’ = f on I, and G(a) = F(a) — F(a) = 0. Thus if [ f exists 
on I, f has a (unique) primitive G on I such that G(a) = 0. (It is unique by 
Theorem 1. Why’) 


Examples. 
(a) Let 
jin= - and F(a) = Inia) with (0) = F0) =. 


Then F’ = f and F = [{ f on (—oo, 0) and on (0, +00) but not on E’, 
since F' is discontinuous at 0, contrary to Definition 1. We compute 


2 
i f =in2=lnl =n, 
1 
(b) On E?, let 
i2= el and F(a) = |a|, with f(0) = 1. 


Here F is continuous and F’ = f on E' — {0}. Thus F = f[ f on E’, 
exact on FE! — {0}. Here I = E?, Q = {0}. 


2 The numbers a and 0 are called the bounds of the integral. 
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We compute 
2 
/ f =F (2) — F(-2) =2-2=0 
=2 


(even though f never vanishes on E?). 


Basic properties of integrals follow from those of derivatives. Thus we have 
the following. 


Corollary 1 (linearity). If [ f and [ g exist on I, so does [(pf +qg) for any 
scalars p, q (in the scalar field of E).? Moreover, for any a, b € I, we obtain 


(i) [orra=vf srafio 
ii [uso fre fis and 
(i) [or=of's 


Proof. By assumption, there are F' and G such that 
F’ = f onI—Q and G’ =g on! —P. 
Thus, setting S = PUQ and H = pF + qG, we have 
H' =pF'+qG' =pf +aqg onI—-S, 


with P, Q, and S countable. Also, H = pF + qG is relatively continuous and 
finite on J, as are F' and G. 
Thus by definition, H = [(pf + qqg) exists on I, and by (1), 


b b b 
; (pf +49) = H(b)—H (a) = pF(b) +qG(b)—pF(a)—gG(a) =p / fra / 2 


proving (i*). 
With p = 1 and q = +1, we obtain (ii*). 
Taking q = 0, we get (iii*). O 


Corollary 2. If both [ f and f |f| exist on I = [a, b], then 


[als fin 


3In the case f, g: E1 + E* (C), we assume p, q € E! (C). If f and g are scalar valued, 
we also allow p and q to be vectors in E. 
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Proof. As before, let 
F' = f and G’ =|f| on I- S (S =QUP, all countable), 


where F’ and G are relatively continuous and finite on J and G = [| |f| is real. 
Also, |F’| = |f| = G’ on I— S. Thus by Theorem 1 of §4, 


b 
FO) — Fla) < G0) — Gta) = fi, 
Corollary 3. If { f exists on I = [a, b], exact on I — Q, then 


[s\<o-o 


for some real 
M< sup [f(t 
teI—Q 


This is simply Corollary 1 of §4, when applied to a primitive, F = [ f. 
Corollary 4. If F = [ f onI and f =g onI—Q, then F is also a primitive 


of g, and 
b b 
[t-f[s fora, bel. 


(Thus we may arbitrarily redefine f on a countable Q.) 


Proof. Let F’ = f on I—P. Then F’ = g on I—(PUQ). The rest is clear. 


Corollary 5 (integration by parts). Let f and g be real or complex (or let 
f be scalar valued and g vector valued), both relatively continuous on I and 
differentiable on I—Q. Then if [ f’g exists on I, so does { fg’, and we have 


b b 
/ fa! = fg(b) — fla)g(a) - / fo forimyeber, (2) 


Proof. By assumption, fg is relatively continuous and finite on J, and 


(fo) =fo' + fig on I-Q. 
Thus, setting H = fg, we have H = /(fg’ + f’g) on I. Hence by Corollary 1, 
if { f’g exists on I, so does [((fg’ + f’g) — f’g) = f fg’, and 


b b b 
/ fg! + / fon ‘ (fg' + f’9) = H(b) — H(a) = f()g(b) — f(a)g(a). 


Thus (2) follows. O 


The proof of the next three corollaries is left to the reader. 
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Corollary 6 (additivity of the integral). If [ f exists on I then, fora, b,c € I, 
we have 


(i) [r-far fr 


(ii) Ne: = 0; and 


(i) [refs 


Corollary 7 (componentwise integration). A function f: E' + E” (C”) 
is integrable on I iff all its components (fi, fa,.--, fn) are, and then (by 
Theorem 5 in §1) 


[i (fn a [ w) “vals for anya, bE I. 


Hence if f 1s complex, 
b b b 
[taf tori f fim 


(see Chapter 4, §3, Note 5). 
Examples (continued). 
(c) Define f: E1 — E? by 
f(x) = (a-cosz, a-sinz, 2cr), a,ce E'. 


Verify that 


= (0, 2a, en”) = 2aj + enk. 


| f(x) dx = (a+ sinx, —a-cos2, cx”) : 
0 


TT 


(d) | e'* dx = | (cosxz +i-sinz) dx = (sinxz —7-cosz) = 2i. 
0 0 
Corollary 8. If f =0 on I—Q, then [ f exists on I, and 


[sl=fiuiro fora, bel. 


Theorem 2 (change of variables). Suppose g: E' > E' (real) is differentiable 
on I, while f: E' + E has a primitive on g{I],* exact on g[I — Q]. 


4 Note that g[J] is an interval, for g has the Darboux property (Chapter 4, §9, Note 1). 
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Then 
/ f(g(a))gl(a) de (é.e., ; Goge 


exists on I, and for any a,b € I, we have 
b q 
[ flo@)a'@ae= | fy)ay, where p= g(a) andq= 90). (3) 
a Pp 


Thus, using classical notation, we may substitute y = g(x), provided that we 
also substitute dy = g'(x) dx and change the bounds of integrals (3). Here we 
treat the expressions dy and g’(x) dx purely formally, without assigning them 
any separate meaning outside the context of the integrals. 


Proof. Let F = f{ f on g[J], and F’ = f on g[I — Q]. Then the composite 
function H = Fog is relatively continuous and finite on J. (Why?) By 
Theorem 3 of 81, 


H' (x) = F’(g(z))g'(x) for « € I—Q; 


L.e., 
H’ = (F’o0g)g' on I—-Q. 


Thus H = [(f og)g’ exists on I, and 


b qd 
7 (f 0g)g! = H(b) — H(a) = F(9(8)) — F(g(a)) = F(q) — Fp) = / Z 


Note 3. The theorem does not require that g be one to one on I, but if 
it is, then one can drop the assumption that f{ f is exact on g[I — Q]. (See 
Problem 4.) 


Examples (continued). 
nm /2 
(e) Find | sin? x - cos x dz. 
0 


Here f(y) = y*, y = g(x) = sinz, dy = cosrdz, F(y) = y?/3, a = 0, 
b=7/2, p=sin0 =0, and gq = sin(7/2) = 1, so (3) yields 


mw /2 1 31 1 1 
+2 2 Y 

pf dx = dy = =| =--0=-. 

/ sIn” @ + COS ZX AX fu Yy 3 |o 3 3 


For real functions, we obtain some inferences dealing with inequalities. 


Theorem 3. If f, g: E' > E' are integrable on I = [a, b], then we have the 
following: 


i720 on I —Q implies [’ f >0. 
@’) f <0 on I—Q implies [° f <0. 
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(ii) f > g on I—Q implies 


b b 
/ f > | g (dominance law). 


(iii) If f >0 onI—Q anda<c<d<b, then 
b d 
/ f > | f (monotonicity law). 


(iv) If he = 0, and f > 0 onI—Q, then f =0 on some I—P, P countable. 


Proof. By Corollary 4, we may redefine f on Q so that our assumptions in 
(i)—(iv) hold on all of I. Thus we write “I” for “I — Q.” 

By assumption, F = [ f and G = | g exist on J. Here F and G are relatively 
continuous and finite on I = [a, b], with F’ = f and G’ = g on I—P, for another 


countable set P (this P cannot be omitted). Now consider the cases (i)—(iv). 
(P is fixed henceforth.) 


(i) Let f > 0 on J;ie., F’ = f >0onJ—P. Then by Theorem 2 in §4, Ft 
on I = [a, b]. Hence F(a) < F(b), and so 


[f-Fw-P@zo 


One proves (i’) similarly. 
(ii) If f — g > 0, then by (i), 


fu-o=fr- foro 


so e > Cs g, as claimed. 
(iii) Let f >Oon J anda<c<d<0b. Then by (i), 


c b 
/ feoand [ 7 =U: 
a d 
Thus by Corollary 6, 


fs-fs+ for [se fs 
as asserted. 


(iv) Seeking a contradiction, suppose ft f =0, f >O0on TZ, yet f(p) > 0 for 
some p € I — P (Pas above), so F’(p) = f(p) > 0. 
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Now if a < p < b, Lemma 1 of §2 yields F'(c) > F(p) for some c € (p, 6]. 
Then by (iii), 


[rz [1=F0-Fo>0 


contrary to : f =0; similarly in casea<p<b. O 
a 


Note 4. Hence 
b 
/ |f| = 0 implies f = 0 on [a,b] — P 


(P countable), even for vector-valued functions (for |f| is always real, and so 
Theorem 3 applies). 


However, ie f =0 does not suffice, even for real functions (unless f is sign- 
constant). For example, 


20 
| sin x dx = 0, yet sinz #0 on any I — P. 
0 


See also Example (b). 


Corollary 9 (first law of the mean). If f is real and [ f exists on a, b], exact 
on (a, b), then 


b 
/ f = f(q)(b—a) for some q € (a, b). 


Proof. Apply Corollary 3 in §2 to the function F = | f. 


Caution: Corollary 9 may fail if [ f is inexact at some p € (a, b). (Exactness 
on [a,b] — Q does not suffice, as it does not in Corollary 3 of §2, used here.) 
Thus in Example (b) above, i f =0. Yet for no q is f(¢g)(2+ 2) =0, since 
f(q) = +1. The reason is that [ f is inexact just at 0, an interior point of 
[—2, 2]. 


Problems on Antiderivatives 


1. Prove in detail Corollaries 3, 4, 6, 7, 8, and 9 and Theorem 3(i’) and 
(iv). 
2. In Examples (a) and (b) discuss continuity and differentiability of f and 


F at 0. In (a) show that [ f does not exist on any interval (—a, a). 
[Hint: Use Theorem 1.] 


3. Show that Theorem 2 holds also if g is relatively continuous on J and 
differentiable on J — Q. 
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. Under the assumptions of Theorem 2, show that if g is one to one on J, 


then automatically | f is exact on g[I — Q] (Q countable). 
[Hint: If F = f f on g[J], then 


F’ = f on g[I| — P, P countable. 


Let Q = g~![P]. Use Problem 6 of Chapter 1, §§4-7 and Problem 2 of Chapter 1, 
89 to show that Q is countable and g[I] — P = g[I — Q].] 


. Prove Corollary 5 for dot products f -g of vector-valued functions. 


. Prove that if [ f exists on [a, p] and [p, 0], then it exists on [a, b]. By 


induction, extend this to unions of n adjacent intervals. 

[Hint: Choose F = f f on [a, p] and G = f f on [p, b] such that F(p) = G(p). 
(Why do such F, G exist?) Then construct a primitive H = f f that is relatively 
continuous on all of [a, }].] 


. Prove the weighted law of the mean: If g is real and nonnegative on 


I = {a, b], and if fg and [gf exist on I for some f: E' + E, then 


there is a finite c € EF with 
b b 
/ gf =c / g- 


(The value c is called a g-weighted mean of f.) 


[Hint: If f° g > 0, put 
b b 
om f ot | f g. 


If 7 g = 0, use Theorem 3(i) and (iv) to show that also ibe gf = 0, so any c will do.] 


- In Problem 7, prove that if, in addition, f is real and has the Darboux 


property on J, then c = f(q) for some q € I (the second law of the 
mean). 


[Hint: Choose c as in Problem 7. If cc g > 0, put 
m = inf f[J] and M = sup f[J/], in E*, 


som < f <M on I. Deduce that 


b b b 
mfo<f ofsmf 9 
a a a 
whence m<c< M. 


Ifm<c< M, then f(x) <c< f(y) for some x, y € I (why?), so the Darboux 
property applies. 

If c =m, then g-(f —c) > 0 and Theorem 3(iv) yields gf = gc on I— P. (Why?) 
Deduce that f(q) = c if g(q) #0 and q€ I — P. (Why does such a q exist?) 

What if c= M?| 


. Taking g(x) = 1 in Problem 8, obtain a new version of Corollary 9. 


State it precisely! 
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=> 10. Prove that if F = [ f on I = (a, b) and f is right (left) continuous and 
finite at p € I, then 


f(p) = F.(p) (respectively, F“ (p)). 


Deduce that if f is continuous and finite on I, all its primitives on I 
are exact on I. 
[Hint: Fix e > 0. If f is right continuous at p, there is c € I (c > p), with 


|f(x) — f(p)| <e for x € [p, c). 


Fix such an x. Let 
G(t) = F(t)—tf(p), t¢ E'. 


Deduce that G’(t) = f(t) — f(p) fort EI -Q. 
By Corollary 1 of §4, 


|G(z) — G(p)| = |F(@) — F(p) — (@ — p)f (p)| < M(a — p), 


with M <e. (Why?) Hence 


AF 
= f(p)| = 5 tor ee |p, €), 
Aa 
and so 
AF 
lim === hy?); 
Roarare f(p) (why?) 


similarly for a left-continuous f.] 
11. State and solve Problem 10 for the case I = [a, 0]. 
12. (i) Prove that if f is constant (f =c # too) on I — Q, then 


b 
/ f=(b-a)c fora,be Tl. 


(ii) Hence prove that if f = c, #4 +00 on 
lie= (Op, Ope), C= 09 Oy <<, = 9, 


then | f exists on [a, b], and 


b n—1 
/ ‘i = So (an41 = Ak) Ck. 
k=0 


Show that this is true also if f = cy, 4 +00 on Ip — Qy. 
[Hint: Use Problem 6.] 


13. Prove that if { f exists on each I, = [an, bn], where 


Geet S On = De S Oper, n=1,2,..., 
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then /{ f exists on 
[= U [an, bia 
n=1 
itself an interval with endpoints a = inf a, and b=supb,, a, b € E*. 


[Hint: Fix some c € 1. Define 


t 
H(t) = f fonlIn,n=1,2,.... 
c 


Prove that 
(Vn<m) Hy = Hm on Ip (since {In}t). 


Thus H,,(t) is the same for all n such that t € In, so we may simply write H for 
Hy on I = UP, In. Show that H = ff on all of I; verify that I is, indeed, an 
interval.| 


14. Continuing Problem 13, prove that | f exists on an interval J iff it exists 
on each closed subinterval |a, b] C I. 


[Hint: Show that each I is the union of an expanding sequence In = [an, bn]. For 
example, if I = (a, b), a, b € E+, put 


1 1 
an =a+— and b, = b— — for large n (how large’?), 
n n 
and show that 


is | Jian, by] over such n.] 


nm 


86. Differentials. Taylor’s Theorem and Taylor’s Series 


Recall (Theorem 2 of §1) that a function f is differentiable at p iff 
Af = fi(p)Ar + 6(x)Az, 


with limz_,, 6(x) = 6(p) = 0. It is customary to write df for f’(p)Ax and 
o(Az) for 6(x)Az;" df is called the differential of f (at p and x). Thus 


Af = df +0(Az); 


i.e., df approximates Af to within o(Az). 
More generally, given any function f: E' > E and p,xz € E', we define 


d” f = d"f (p, x) = f™(p)(x—p)”, nm=0, 1, 2,..., (1) 


1 This is the so-called “little o” notation. Given g: E! > E', we write o(g(x)) for any 
expression of the form 6(x)g(a), with 6(a) > 0. In our case, g(a) = Az. 
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where f(”) is the nth derived function (Definition 2 in §1); d”f is called the 
nth differential, or differential of order n, of f (at p and x). In particular, 
d' f = f'(p)Aa = df.? By our conventions, df is always defined, as is . 

As we shall see, good approximations of Af (suggested by Taylor) can often 
be obtained by using higher differentials (1), as follows: 

af df d" f 
Af=dft+aotapttap tha, = Te Dy, das (2) 

where 


nak 
R, = Af - ar (the “remainder term” ) 


is the error of the approximation. Substituting the values of Af and d*f and 
transposing f(p), we have 


f'(p) 
1! 


(n) 
(e—pyt- + Pepe Ry, (3) 


f"() 


f(x) = fp) + 7 


(2 —p)+ 


Formula (3) is known as the nth Taylor expansion of f about p (with remain- 
der term R,, to be estimated). Usually we treat p as fixed and x as variable. 
Writing R,,(x) for R, and setting 


we have 


The function P,,: E! — E so defined is called the nth Taylor polynomial for 
f about p. Thus (3) yields approximations of f by polynomials P,, n = 
1, 2,3,.... This is one way of interpreting it. The other (easy to remem- 
ber) one is (2), which gives approrimations of Af by the d*f. It remains, 
however, to find a good estimate for R,. We do it next. 


Theorem 1 (Taylor). Let the function f: E1 > E and its first n derived 
functions be relatively continuous and finite on an interval I and differentiable 
on I—Q (Q countable). Let p, x € I. Then formulas (2) and (3) hold, with 


1 x 
f= a fD(t)- (a — 1)" dt (“integral form of Ry”) (a 
‘Jp 
and 
aap int) i" 
|Rn| <M,————— for some real M,, < sup |f (t)|. (3”) 
(n+ 1)! teI-Q 


? Footnote 2 of §1 applies to d” f, as it does to Af (and to Ry, defined below). 
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Proof. By definition, R, = f — Pp, or 
k 


Rn = Ha) $0) — 1) 


We use the right side as a “pattern” to define a function h: E! > E. This 
time, we keep x fixed (say, x = a € I) and replace p by a variable t. Thus we 
set 

FM) 


n! 


(a—t)” for allie BE’. (4) 


Then h(p) = R, and h(a) = 0. Our assumptions imply that h is relatively 
continuous and finite on J, and differentiable on J — Q. Differentiating (4), we 
see that all cancels out except for one term 


n 


—t 
h/(t) = — pony ei" teI—Q. (Verify!) (5) 
Hence by Definitions 1 and 2 of §5, 


—h(t) = =f fF(s)(a—s)"ds onl 


f° ()\(a— 1)" dt = —A(a) + A(p) =0+ Rn = Rn (for h(p) = Rn). 


As x =a, (3’) is proved. 
Next, let 
M= sup [ft 
teI—Q 
If M < +o, define 


t— n+1 —f¢ n+1 
ene for t > a and g(t) --u fort <a. 
In both cases, 


la—+|” 
n! 


g(t) =M > |h'(t)| on I — Q by (5). 
Hence, applying Theorem 1 in §4 to the functions h and g on the interval [a, p] 
(or [p, a]), we get 
|h(p) — h(a)| < |g) — 9(a)], 
or 
Ja — p|rt 


R=) 
| is (n+ 1)! 
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Thus (3”) follows, with M, = M. 
Finally, if MZ = +co, we put 
(n+ 1)! 
ja — pint 


Mn = Eee | <M. U 
For real functions, we obtain some additional estimates of R,,. 


Theorem 1’. /f f is real andn+1 times differentiable on I, then forp#~«x 
(p, x € I), there are dn, gj, in the interval (p, x) (respectively, (x, p)) such that 


(n+1) 
0 = tele — py (5) 

and nding 
Ry = Mol og — p(w — a) (5") 


(Formulas (5’) and (5) are known as the Lagrange and Cauchy forms of 
Rn, respectively. ) 
Proof. Exactly as in the proof of Theorem 1, we obtain the function h and 
formula (5). By our present assumptions, h is differentiable (hence continuous) 
on I, so we may apply to it Cauchy’s law of the mean (Theorem 2 of §2) on 
the interval [a, p] (or [p, a] ifp <a), wherea=a2 € I. 

For this purpose, we shall associate h with another suitable function g (to 
be specified later). Then by Theorem 2 of §2, there is a real q € (a, p) (respec- 
tively, gq € (p, a)) such that 


g'(q)[h(a) — h(p)] = h'(@)[9(@) — 9(p)]- 
Here by the previous proof, h(a) = 0, h(p) = Ry, and 


(n+1) 
h'(q) =-——(a-@)". 
Thus fea 
o'(a)- Ry = D(a — @)"[o(a) — 910) (6) 


Now define g by 
g(t) =a-t, te E’. 
Then 
g(a) — g(p) = —(a— p) and g(q) = -1, 
so (6) yields (5”) (with gj, = q anda= 2). 
Similarly, setting g(t) = (a — t)"*, we obtain (5’). (Verify!) Thus all is 
proved. 
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Note 1. In (5’) and (5”), the numbers gq, and qj, depend on n and are 
different in general (qr, 4 qj,), for they depend on the choice of the function g. 
Since they are between p and x, they may be written as 


dn = p+ O,(a — p) and g, =p+6@,(x — p), 


where 0 < 6, <1 and0< 6}, <1. (Explain!) 


Note 2. For any function f: E! > E, the Taylor polynomials P,, are partial 
sums of a power series, called the Taylor series for f (about p). We say that f 
admits such a series on a set B iff the series converges to f on B; i.e., 


(a= im Pa) = > ee (x — p)” # too for x € B. (7) 
n=1 : 


briefly, R,, — 0. Thus 
f admits a Taylor series (about p) iff Rn — 0. 


Caution: The convergence of the series alone (be it pointwise or uniform) 
does not suffice. Sometimes the series converges to a sum other than f(x); then 
(7) fails. Thus all depends on the necessary and sufficient condition: R, — 0. 

Before giving examples, we introduce a convenient notation. 


Definition 1. 


We say that f is of class CD”, or continuously differentiable n times, ona 
set B iff f is n times differentiable on B, and f\” is relatively continuous 
on B. Notation: f € CD” (on B). 


If this holds for each n € N, we say that f is infinitely differentiable 
on B and write f € CD®™ (on B). 


The notation f € CD° means that f is finite and relatively continuous 
(all on B). 


Examples. 
(a) Let 
fee ome, 


Then 
(Va) FUG) =e%, 


so f € CD™ on E!. At p=0, f'™(p) = 1, so we obtain by Theorem 1’ 
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(using (5’) and Note 1) 


Aig oy Oe Gee es (8) 
7 1! 2! 1 (n+1)! ve 
Thus on an interval |—a, al, 
aq ae © x? x” 
ra ek eae 


to within an error R, (> 0 if « > 0) with 


n+1 
R,| < e*——, 
[Rn “ ™m+D! 
which tends to 0 as n + +00. Fora=1 = 42, we get 
ree: 1 e 


Taking n = 10, we have 
e © 2.7182818]011463845... 


with a nonnegative error of no more than 


a — 0.00000006809869. ..: 


all digits are correct before the vertical bar. 
(b) Let 
fx= el with f(0) =0. 


As limz40 f(z) = 0 = f(0), f is continuous at 0.2 We now show that 
f € CD® on E!. 


For « 4 0, this is clear; moreover, induction yields 
7 (x) = e/a" 7-3ng (a), 


where S;, is a polynomial in x of degree 2(n — 1) (this is all we need know 
about S,,). A repeated application of L’H6pital’s rule then shows that 


lim f(”) (2) = 0 for each n. 


xz—0 


To find f’(0), we have to use the definition of a derivative: 


(0) = tim £@)- FO 


x0 z—O : 


3 At other points, f is continuous by the continuity of exponentials. 
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or by L’Hopital’s rule, 


A ae a 


Using induction again, we get 
f™(0)=0, n=1,2,.... 


Thus, indeed, f has finite derivatives of all orders at each x € E?, includ- 
ing = 0, so f € CD™ on E!, as claimed. 

Nevertheless, any attempt to use formula (3) at p = 0 yields nothing. 
As all f( vanish at 0, so do all terms except R,,. Thus no approximation 
by polynomials results—we only get P, = 0 on E! and R,(x) = e~/ x 
R,, does not tend to 0 except at x = 0, so f admits no Taylor series about 
0 (except on E = {0}).4 


Taylor’s theorem also yields sufficient conditions for maxima and minima, 
as we see in the following theorem. 
Theorem 2. Let f: E' + E* be of class CD" on G,(6) for an even number 
n > 2, and let 
f(p) =0 fork =1,2,...,n—1, 


while 
fp) < 0 (respectively, fp) > 0). 
Then f(p) is the maximum (respectively, minimum) value of f on some Gp(¢), 
e<o. 
If, however, these conditions hold for some odd n > 1 (i.e., the first non- 


vanishing derivative at p is of odd order), f has no maximum or minimum 
at p. 


Proof. As 
f(p) =0, k=1,2,...,n—-1, 


Theorem 1’ (with n replaced by n — 1) yields 
rT nm 
fe) =F) + F (Gn) for all a € Gy(d), 


with qn, between x and p. 
Also, as f € CD", f™ is continuous at p. Thus if f()(p) < 0, then f™ <0 
on some G,(e), 0 < e < 6. However, x € G,(e) implies qn € Gp(e), so 


f™ (an) < 0, 


4 Taylor’s series with p = 0 is often called the Maclaurin series (though without proper 
justification). As we see, it may fail even if f € CD© near 0. 
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while 

(x — p)” > 0 if n is even. 
It follows that 
(2 — p)” 


<0 
n! - 


f™ (dn) 


3 


and so 
n wt Pp “ 

f(x) = f(p) +f! Ge) < f(p) for €G,(e), 

ie., f(p) is the maximum value of f on G,(e), as claimed. 
Similarly, in the case f((p) > 0, a minimum would result. 

If, however, n is odd, then (x — p)” is negative for x < p but positive for 
x > p. The same argument then shows that f(x) < f(p) on one side of p and 
f(x) > f(p) on the other side; thus no local maximum or minimum can exist 
at p. This completes the proof. 


Examples. 
(a’) Let 
f(x) = 2? on E! and p=0. 
Then 
F'(@) = 2¢ and f"(e)=2> 0, 
so 


f'(0)=0 and 7"(0) =2> 0. 


By Theorem 2, f(p) = 0? = 0 is a minimum value. 
It turns out to be a minimum on all of E‘. Indeed, f'(x) > 0 for x > 0, 
and f’ < 0 for x < 0, so f strictly decreases on (—oo, 0) and increases on 


(0, +00). 
Actually, even without using Theorem 2, the last argument yields the 
answer. 
(b’) Let 
f(x) = Inz on (0, +00). 
Then 


1 
f(e)= ae 0 on all of (0, +00). 


This shows that f strictly increases everywhere and hence can have no 
maximum or minimum anywhere. The same follows by the second part 
of Theorem 2, with n = 1. 


(b’) In Example (b’), consider also 


i 2S -5 <0, 
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In this case, f” has no bearing on the existence of a maximum or minimum 
because f’ 4 0. Still, the formula f” < 0 does have a certain meaning. In 
fact, if f’(p) < 0 and f € CD? on G, (6), then (using the same argument 
as in Theorem 2) the reader will easily find that 


f(x) < f(p)+ f'(p)(a@— p) for x in some G,(e), 0<e <6. (10) 


Since y = f(p)+f'(p)(x—p) is the equation of the tangent at p, it follows 
that f(x) < y; ie., near p the curve lies below the tangent at p. 

Similarly, f’”(p) > 0 and f € CD? on G,,(6) implies that the curve near 
p lies above the tangent. 


Problems on Taylor’s Theorem 
1. Complete the proofs of Theorems 1, 1’, and 2. 
2. Verify Note 1 and Examples (b) and (b”). 
3. Taking g(t) = (a—t)*, s > 0, in (6), find 
fN"@) 
nls 
Obtain (5’) and (5”) from it. 
4. Prove that P,, (as defined) is the only polynomial of degree n such that 


n+l1—-s 


Rr (x — p)*(x — q) (Schloemilch-Roche remainder). 


PY O=H=P PO), =O; Lwiegm 


[Hint: Differentiate P, n times to verify that it satisfies this property. 
For uniqueness, suppose this also holds for 


nm 


P(x) = Ss a, (x — p)*. 


k—O 
Differentiate P n times to show that 
P‘) (p) = f) (p) = agh!, 
so P = Py. (Why?) 
5. With P,, as defined, prove that if f is n times differentiable at p, then 
f(x) — Py(@) = o((@ — p)") as « > p 
(Taylor’s theorem with Peano remainder term). 
[Hint: Let R(x) = f(x) — Pp(x) and 
R(z) 
(x — p)” 


Using the “simplified” L’Hépital rule (Problem 3 in §3) repeatedly n times, prove 
that limg-+p d(x) = 0.] 


d(x) = with d(p) = 0. 


86. Differentials. Taylor’s Theorem and Taylor’s Series 


297 


6. Use Theorem 1’ with p = 0 to verify the following expansions, and prove 


that limy-+. Rn = 0. 


; 7 7? (yg * (pega 
(a) sing = x — — + — —.-- — ~—+~—___ + +~_~_____ cos 4,2 
31" 5! (2m — 1)! (Qm +1)! 
for all « € FE; 
a2 at (—1)"z2™ (1g 
(b) COST = i a "oa Cnr for 
all x € E. 


[Hints: Let f(a) = sina and g(x) = cosa. Induction shows that 


f(x) = sin (2 ae “) and g’™ (a) a cos(« £ =). 


Using formula (5’), prove that 
grtt 
|Rn(x)| < |_| > 0. 
(n+ 1)! 


Indeed, x”/n! is the general term of a convergent series 


S> aif (see Chapter 4, §13, Example (d)). 


n) 
Thus 2”/n! > 0 by Theorem 4 of the same section.] 


7. For any s € E! and n€ N, define 


(2) = oD 04D oan (8) 


Then prove the following. 


(i) lim n(*) =Oifs>0. 
nr 


N— Co 


N— oo 


(ii) lim (*) =Oifs>-—l. 
nr 


(iii) For any fixed s € E' and z € (—1, 1), 


lim lcs =: 
Noo Nn 


lim (=) = 0. 
Nn CoO n 


[Hints: (i) Let an = ae) . Verify that 
n 


hence 


Eee a he (ane | eo 
a = |S —_ — —_ — eee ———s 
o 1 2 


—\ 
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If s > 0, {an}) for n > s+1, so we may put L = limayn = limag, > 0. (Explain!) 
Prove that 


a2n al hg —ts 
—— < |l=s=| =e 2 as Nn — OOo, 
an 2n 
so for large n, 
a2n —i F -i 
— <e 2° +6; ie, dan <(e€ 2° +2)an. 
an 


With ¢ fixed, let n + oo to get L < (e~ 25 +e)L. Then with ¢ > 0, obtain Le2® <L. 
Ase2°>1 (for s > 0), this implies L = 0, as claimed. 

(ii) For s > —1, s+1> 0, so by (i), 
+ 1 

) + 0; ie, (s+ 1)( ) +0. (Why?) 


sc s 
n+1 n 


(n+1)( 


8 
(iii) Use the ratio test to show that the series S- ( 


) na” converges when |z| < 1. 
Then apply Theorem 4 of Chapter 4, §13.] 


nm 


. Continuing Problems 6 and 7, prove that 


(la) = Ss" (;) a* + R(x), 
k=0 
where R,,(x) > 0 if either |z| < 1, or x =1 and s > —1, or x = —1 and 


s > 0. 
[Hints: (a) If 0 < a2 < 1, use (5’) for 


Rn—1(x) = (yer +6n2)°-", O<On <1. (Verify!) 
n 
Deduce that |Rn—1(«x)| < | Ca" — 0. Use Problem 7(iii) if |2| < 1 or Problem 7(ii) 
ife=1. uv 
(b) If -1 < a < 0, write (5’’) as 
— s n / —1 Li Oi na ! 
Rn-1(#) = (7) na (14+ 6),2)s (—* ri oa) . (Check!) 
As —1 <2 <0, the last fraction is < 1. (Why?) Also, 
(146) 2)9-! <1ifs>1,and <(1+2)*"1 ifs <1. 


Thus, with x fixed, these expressions are bounded, while (*) na” — 0 by Problem 7(i) 
or (iii). Deduce that Ryn; — 0, hence Ryn — 0.] 


. Prove that 


n 


In(l + #) = ars + Rn(2), 


where limn_+o Rn(z) =0 if -l<a <1. 
[Hints: If 0 < x < 1, use formula (5’). 
If —1 < a < 0, use formula (6) with g(t) = In(1 + ¢) to obtain 


Ra) = | 1-0 2)". 


(-1)” \14+6n2 
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10. 


11. 


12. 


Proceed as in Problem 8.] 


Prove that if f: E1 > E* is of class CD! on [a, b] and if —oo < f” <0 
on (a, 6), then for each x € (a, b), 


F(a) > OL) (0, — a) + F(a): 
i.e., the curve y = f(x) lies above the secant through (a, f(a)) and 


(b, f(b). 


[Hint: This formula is equivalent to 


(wo) = Fla), f@)= Fla) 


Io9—a b-—a 


i.e., the average of f’ on [a, zo] is strictly greater than the average of f’ on [a, 5], 
which follows because f’ decreases on (a,b). (Explain!)| 


Prove that if a, b, r, and s are positive reals and r + s = 1, then 
a’b® <ra+ sb. 


(This inequality is important for the theory of so-called L?-spaces.) 
[Hints: If a = 6, all is trivial. 


Therefore, assume a < b. Then 
a=(r+s)a<ra+sb<b. 
Use Problem 10 with zo = ra + sb € (a, b) and 
1 
f(z) =Ina, f"(«) =-= <0. 
x 


Verify that 
Lo -a=249 —(r+s)a=s(b—-a) 


and r-lna = (1—s) Ina; hence deduce that 
r-Ina+s-lnb— Ina = s(Inb— Ina) = s(f(b) — f(a)). 
After substitutions, obtain 


f(xo) = In(ra + sb) > r-Ina+s-Inb= In(a’b’).] 
Use Taylor’s theorem (Theorem 1’) to prove the following inequalities: 
(a) Vita < +2 ife>—l,2 £0. 
1 
(b) cosz >1— xt if o #0. 


x 
(c) ine <— arcing <a it > 0, 


1 
(d) x>sing >a — =a if x > 0. 
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§7. The Total Variation (Length) of a Function f: E1 > E 


The question that we shall consider now is how to define reasonably (and 
precisely) the notion of the length of a curve (Chapter 4, §10) described by a 
function f: E1 — E over an interval I = [a, 9], i.e., f[J]. 
We proceed as follows (see Figure 24).1 
Subdivide [a, 6] by a finite set of 
points P= {tg ti, 2.45 by fy With 


fj ig She 2S i, =P; 


qi = f(t) 
P is called a partition of [a, b]. Let 
eS Flay OS 1 Dy cong, 
and, for? = 1, 2, <«s5 M7, 
Aif =G — G-1 q3 = f (ts) 
= f (ti) — f(ti-1). oS re 


We also define 
S(f, P) = >—lAcfl = > las — gal. 
i=l i=l 


Geometrically, |A;f| = |¢i-—qi-1| is the length of the line segment L[qi-i, qil 
in E, and S(f, P) is the sum of such lengths, i.e., the length of the polygon 


FIGURE 24 


i= U Liqi-1, 4: 


i=1 
inscribed into f[I|; we denote it by 
iW = Ss, P). 
Now suppose we add a new partition point c, with 
a1 SCS 
Then we obtain a new partition 
P= {to, via bitin ly bee wees tags 


called a refinement of P, and a new inscribed polygon W, in which L/qi—1, qi is 
replaced by two segments, L[q:-1, q| and L{q, qi], where g = f(c); see Figure 24. 
Accordingly, the term |A;f| = |q; — qj-1| in S(f, P) is replaced by 


la; —@| + la —q-i1| => las —qi_-i| (triangle law). 


1 Note that this method works even if f is discontinuous. 
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It follows that 
Of) So, Pais tw a iW es 


Hence we obtain the following result. 
Corollary 1. The sum S(f, P) =@W cannot decrease when P is refined. 


Thus when new partition points are added, S(f, P) grows in general; i.e., 
it approaches some supremum value (finite or not). Roughly speaking, the 
inscribed polygon W gets “closer” to the curve. It is natural to define the 
desired length of the curve to be the lub of all lengths @W, i.e., of all sums 
S(f, P) resulting from the various partitions P. This supremum is also called 
the total variation of f over [a, b], denoted Vs {a, b].? 

Definition 1. 


Given any function f: EH! > E, and I = [a, b| c E', we set 


Vell] = Vela, 6] = sup S(f, P) = sup ) | f(t) -—fGa)|>0mE*, (1) 


i=l 


where the supremum is over all partitions P = {to, ..., tm} of I. We call 
Vy [I] the total variation, or length, of f on I. Briefly, we denote it by Vr. 


Note 1. If f is continuous on [a, bj, the image set A = f{J] is an arc 
(Chapter 4, §10). It is customary to call V[I] the length of that arc, denoted 
é¢A or briefly 2A. Note, however, that there may well be another function 
g, continuous on an interval J, such that g[J]| = A but Vy[J] # V,[J], and 
so lA A €,A. Thus it is safer to say “the length of A as described by f on 
I.” Only for simple arcs (where f is one to one), is “CA” unambiguous. (See 
Problems 6-8.) 

In the propositions below, f is an arbitrary function, f: E! > E. 


Theorem 1 (additivity of Vy). Ifa<c<b, then 
Vela, b] = Vela, c] + Vee, 8); 
i.e., the length of the whole equals the sum of the lengths of the parts. 
Proof. Take any partition P = {to, ..., tm} of [a, 6]. Ifc ¢ P, refine P to 
Pad te, ahve ti toy ote 


Then by Corollary 1, S(f, P) < S(f, Pe). 
Now P, splits into partitions of [a, c] and |c, b], namely, 


Pe Ti oueg Giadey and PY = 1a. ti, wensg Res 


? We also call it the length of f over [a, b]. Observe that, for real f: E! > E?, this is not 
the length of the graph in the usual sense (which is a curve in E?). See the end of §8. 
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so that 
S(f, P)+S(f, P”) =S(f, Pe). (Verify!) 


Hence (as Vy is the lub of the corresponding sums), 
Vela, c] + Velc, d] > S(f, Pc) = S(f, P). 
As P is an arbitrary partition of [a, b], we also have 
Vela, c] + Ve[c, b] > sup S(f, P) = Vela, 8]. 
Thus it remains to show that, conversely, 
Vela, 6] > Vela, c] + Velc, 6). 


The latter is trivial if V¢[a, b] = +oo. Thus assume Vela, b] = kK < +00. Let 
P’ and P” be any partitions of |a, c] and [c, 6], respectively. Then P* = P’UP” 
is a partition of |a, b], and 


S(f, P')+ S(f, P”) = S(f, P*) < Vyla, 6] = K, 


whence 


S(f, P< K-S8(f, P"). 


Keeping P” fixed and varying P’, we see that K — S(f, P’’) is an upper bound 
of all S(f, P’) over |a, c]. Hence 


Vela, c] < K—S(f, P”) 


or 


S(f, P") < K —V;[a, cl]. 
Similarly, varying P’”, we now obtain 
Velc, 6] < Kk — Vela, c] 


or 


Vela, c] + Vy[c, b] < K = Vela, 8), 


as required. Thus all is proved. 


Corollary 2 (monotonicity of Vr). Ifa<ce<d<b, then 
Velc, d] < Vela, OB]. 


Proof. By Theorem 1, 


Vela, b] = Vela, c] + Ve[c, d] + Ve[d, 6] > Ve[c, dl. O 
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Definition 2. 


If Vela, b] < +00, we say that f is of bounded variation on I = [a, b], and 
that the set f[I] is rectifiable (by f on I). 


Corollary 3. For each t € [a, 0], 
If(t) — fla)| < Vela, 2). 


Hence if f is of bounded variation on |a, b], it is bounded on |{a, Db]. 


Proof. If t € |a, bj, let P = {a, t, b}, so 
lf(t) — f(a)| < If) — F(@)| + |f(2) —- F®| = SCF, P) < Vela, 4], 


proving our first assertion.* Hence 


(Vie [a, BJ) IFMI SIF) — Fa) +IF@IS Vela, 4] + I f(@)I- 


This proves the second assertion. 


Note 2. Neither boundedness, nor continuity, nor differentiability of f on 
[a, b] implies Vy[a, b] < +00, but boundedness of f’ does. (See Problems 1 and 
3.) 


Corollary 4. A function f is finite and constant on |a, b] iff Ve[a, b] = 0. 
The proof is left to the reader. (Use Corollary 3 and the definitions.) 


Theorem 2. Let f,g,h be real or complex (or let f and g be vector valued 
and h scalar valued). Then on any interval I = [a, b], we have 


(i) Vig, < Ves 
(ii) Veto < Ve + Va; and 
(iii) Vag < sV_ +rVp, with r =supre,|f(t)| and s = sup,<; |A(t)|- 


Hence if f, g, and h are of bounded variation on I, so are f+g, hf, and |f\. 


Proof. We first prove (iii). 
Take any partition P = {to, ..., tm} of J. Then 


JAchf] = |R(ti) (ti) — h(ti-1) F(ti-1)| 
< |h(ti) f(s) — h(ti-1) f (ti) | + [R(i-1) F(a) — ACG -1) F(i-1)| 
= |f(ti)|[Aih| + [ACti-1) [Ac 
< rlAjh| + 8|Aif]. 
Adding these inequalities, we obtain 


S(hf, P) <r-S(h, P) +8-S(f, P) <rVpn + 5Vz5. 


3 By our conventions, it also follows that | f(a)| is a finite constant, and so is V;[a, b]+|f(a)| 
if Vy[a, 6] < +00. 


304 Chapter 5. Differentiation and Antidifferentiation 


As this holds for all sums S(hf, P), it holds for their supremum, so 
Vat = sup S(hf, P) <rV,+ sVy, 


as claimed. 
Similarly, (i) follows from 


If (ta) | = |f tei) || S |FGa) — Fe) |- 
The analogous proof of (ii) is left to the reader. 
Finally, (i)—(iii) imply that Vy, Vr+,, and Vpy are finite if Vs, Vj, and V;, 
are. This proves our last assertion. 


Note 3. Also f/h is of bounded variation on J if f and h are, provided h 
is bounded away from 0 on I; i.e., 


(de>0) |h| >e onl. 


(See Problem 5.) 
Special theorems apply in case the range space E is E' or E” (*or OC”). 


Theorem 3. 


(i) A real function f is of bounded variation on I = [a, }] iff f = g —h for 
some nondecreasing real functions g and h on I. 


(ii) If f is real and monotone on I, it is of bounded variation there. 
Proof. We prove (ii) first. 
Let ff om J. lf P =4tpcssey ty}, then 
t; > ty_1 implies f(t;) > f(4i-1). 
Hence A;f > 0; i-e., |A;f| = A; f. Thus 


5. )\S 2 JAif| = AS = ar) — f(ti-1)] 


= f (tm) — f(to) = f(o) — f(a) 
for any P. (Verify!) This implies that also 
Vill] = sup S(f, P) = f(b) — fla) < +00. 
Thus (ii) is proved. 
Now for (i), let f = g —hA with gt and ht on I. By (ii), g and h are of 
bounded variation on J. Hence so is f = g — h by Theorem 2 (last clause). 
Conversely, suppose V;[I| < +oo. Then define 
giz) =V le, a|,e-e1,and.4=9—/f on I, 


so f =g—A, and it only remains to show that gt and ht. 
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To prove it, let a< a<y<b. Then Theorem 1 yields 


Vela, y] — Vela, x] = Velx, y); 


gly) = g(a) = Vile, ul > |f(W) — F(@)| 20 (by Corollary 3). (2) 
Hence g(y) > g(x). Also, as h = g — f, we have 
h(y) — h(x) = g(y) — f(y) — [9(2) — Fle) 
= g(y) — g(x) — [F(y) — F(z) 
>0_ by (2). 


Thus h(y) > h(x). We see that a < x < y < b implies g(x) < g(y) and 
h(x) < h(y), so ht and gt, indeed. 


Theorem 4. 
(i) A function f: E' + E” (*C™) is of bounded variation on I = {a, b] iff 
all of its components (fi, fo, .--, fn) are. 


(ii) If this is the case, then finite limits f(pt) and f(q~) exist for every 
p € |a, b) and q € (a, 8]. 


Proof. 
(i) Take any partition P = {to, ..., tm} of J. Then 


fut) — faa)? < > pate pr =i@)—fe/; 
j=l 
ey |Agiel S |Agt let = 1y 2h nog 9 Ths 
(VP) S(fk,P) < S(f, P) < Vy, 
and Vy, < V¢ follows. Thus 
Ve +o0 implies Ve oo, K= 1.2). cag 
The converse follows by Theorem 2 since f = S77_, fréx- (Explain!) 


(ii) For real monotone functions, f(p*) and f(q~) exist by Theorem 1 of 
Chapter 4, §5. This also applies if f is real and of bounded variation, for 
by Theorem 3, 


f = g—h with gt and ht on J, 
and so 
f(p*) = g(p*) — h(p*) and f(q~) = g(q7) — h(q_) exist. 
The limits are finite since f is bounded on J by Corollary 3. 
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Via components (Theorem 2 of Chapter 4, §3), this also applies to 
functions f: E' > E”". (Why?) In particular, (ii) applies to complex 
functions (treat C as E”) (*and so it extends to functions f: LE} + C” 
as well). O 


We also have proved the following corollary. 


Corollary 5. A complex function f: E' > C is of bounded variation on [a, b| 
iff its real and imaginary parts are. (See Chapter 4, §3, Note 5.) 


Problems on Total Variation and Graph Length 


1. In the following cases show that V+[Z] = +00, though f is bounded on 
I. (In case (iii), f is continuous, and in case (iv), it is even differentiable 


on I.) 
1 if a € R (rational), and 
i) For J = fa, b <0); = 
(i) For T= [0,8] (a<0), f@)={ 0 ee ean 


(iy. J (a) = sin JO) =02= (6, 6.4505 ba <b, 


(iii) f(x) =2-sin =i f(0) =0; I= (0, 1]. 


1 
(iv) f(x) = x sin =i (O00 t= 0, 1), 
[Hints: (i) For any m there is P, with 

|Aif| =1, t=1, 2,...,m, 


so S(f, P) =m — +o0. 
(iii) Let 


B= {o, - —, aes 4 i}. 
Prove that S(f, Pm) > %L1 ¢ 7 +001] 
2. Let f: E' > E' be monotone on each of the intervals 
[ax—1, Gk], K=1,...,n (“piecewise monotone’ ). 
Prove that , 
Velao, Qn] = ». |f(a%) — f(@n—1)]- 
k=1 


In particular, show that this applies if f(x) = >, civ’ (polynomial), 
with c; € E ut 
[Hint: It is known that a polynomial of degree n has at most n real roots. Thus it 


is piecewise monotone, for its derivative vanishes at finitely many points (being of 
degree n — 1). Use Theorem 1 in §2.| 


§7. The Total Variation (Length) of a Function f: E! > E 307 


=>3. Prove that if f is finite and relatively continuous on I = [{a, b], with a 
bounded derivative, | f’| <M, on I — Q (see §4), then 


Vela, 6] < M(b—a). 
However, we may have V;[I] < +00, and yet |f’| = +00 at some p € I. 
[Hint: Take f(x) = <x on [—1, 1].] 
4. Complete the proofs of Corollary 4 and Theorems 2 and 4. 


5. Prove Note 3. 
[Hint: If |h| > € on J, show that 
1 1 |A;h| 
oe 
h(t;) h(ti—1) —  ¢2 


and hence 


ee 


Deduce that ¢ is of bounded variation on I if h is. Then apply Theorem 2(iii) to 
are 
6. Let g: E' — E' (real) and f: E’ > E be relatively continuous on 
J = |c, d| and I = [a, 6], respectively, with a = g(c) and b = g(d). Let 
k= og. 
Prove that if g is one to one on J, then 
(i) g|J] =I, so f and h describe one and the same arc A = f [I] = h[J]; 
(ii) Ve(Z] = ValJ]; ie., €¢A = €,A. 


[Hint for (ii): Given P = {a = to, ..., tm = b}, show that the points s; = g~1(t;) 
form a partition P’ of J = [c, d], with S(h, P’) = S(f, P). Hence deduce V¢ [I] < 
Vi [J]: 
Then prove that V;,[J] < V [J], taking an arbitrary P’! = {c = 80, ..., 8m = d}, 
and defining P = {to, ..., tm}, with t; = g(s;). What if g(c) = b, g(d) = a?| 
7. Prove that if f, h: E' > E are relatively continuous and one to one on 
I =|a, 6] and J = [c, d], respectively, and if 


fll] =AlJ] =A 
(i.e., f and h describe the same simple arc A), then 
LpA=2,A. 


Thus for simple arcs, fA is independent of f. 

(Hint: Define g: J ~ E! by g = f~toh. Use Problem 6 and Chapter 4, §9, 
Theorem 3. First check that Problem 6 works also if g(c) = b and g(d) = a, ie., gl) 
on J.] 
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8. Let I = [0,27] and define f, g, h: E! — E? (C) by 
je) =(ne;cosz), 
g(x) = (sin 3x, cos 3a), 


Ros (sin =, cos =) with h(0) = (0, 1). 


Show that f[Z] = g[Z] = h[J] (the unit circle; call it A), yet 0A = 27, 
é,A = 62, while V;,[I] = +00. (Thus the result of Problem 7 fails for 
closed curves and nonsimple arcs.) 


9. In Theorem 3, define two functions G, H: E' > E! by 


Gla) = 51Vsla, a] + Fle) - Fla) 
and 
H(2) = G(e) ~ fe) + F(a). 


(G and H are called, respectively, the positive and negative variation 
functions for f.) Prove that 


(i) Gt and H* on [a, 5}; 
(ii) f(x) = G(x) —|[H(x) — f(a)] (thus the functions f and g of Theo- 


rem 3 are not unique); 
(iii) Vela, c] = G(x) + H(a); 
(iv) if f = g —h, with gt and At on {a, b], then 
Vala, 6] < V,[a, b], and Vz[a, b] < V;,[a, 8]; 
(v) G(a) = H(a) =0. 


*10. Prove that if f: E' — E” (C”) is of bounded variation on I = [a, }}, 
then f has at most countably many discontinuities in I. 


[Hint: Apply Problem 5 of Chapter 4, §5. Proceed as in the proof of Theorem 4 in 
§7. Finally, use Theorem 2 of Chapter 1, §9.] 


88. Rectifiable Arcs. Absolute Continuity 
If a function f: E1 > E is of bounded variation (§7) on an interval I = {a, 0], 
we can define a real function vr on I by 

v(x) = Vela, x] (= total variation of f on [a, x]) for x € I; 


vy is called the total variation function, or length function, generated by f on 
I. Note that v»f on I. (Why?) We now consider the case where f is also 
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relatively continuous on I, so that the set A = f{I] is a rectifiable arc (see 87, 
Note 1 and Definition 2). 
Definition 1. 
A function f: E' > E is (weakly) absolutely continuous! on I = [a, b] iff 
Vy [I] < +00 and f is relatively continuous on I. 
Theorem 1. The following are equivalent: 
(i) f is (weakly) absolutely continuous on I = |{a, b); 
(ii) vy ts finite and relatively continuous on I; and 


(iii) (Ve > 0) (46 >0) Va,yeT|O<y—a2 <4) Vela, y] <e. 


Proof. We shall show that (ii) => (iii) > (i) => (ii). 
(ii) = (iii), As I = [a, b] is compact, (ii) implies that vy is uniformly 
continuous on I (Theorem 4 of Chapter 4, §8). Thus 


(Ve >0) (46 >0) Va,yel|O0<y-—a2<6) vs(y)—v;(e) <e. 
However, 
us(y) — vp (2) = Vela, y] — Vela, a] = Vole, 9] 


by additivity (Theorem 1 in §7). Thus (iii) follows. 
(iii) > (i). By Corollary 3 of §7, |f(x) — f(y)| < Velax, y]. Therefore, (iii) 
implies that 


(Ve >0) (Ad >0) (Va, yeT||e—yl<d) |f(@)-fwl<e, 


and so f is relatively (even uniformly) continuous on I. 
Now with ¢ and 6 as in (iii), take a partition P = {to, ..., tm} of I so fine 
that 


=e <b, FS 12h ncey MH: 


Then (Vi) Ve[ti-1, ti] < ¢. Adding up these m inequalities and using the 
additivity of Vr, we obtain 


Ve] = >- Velti-a, ti] < me < +00. 
i=l 


Thus (i) follows, by definition. 
That (i) = (ii) is given as the next theorem. OU 


1 In this section, we use this notion in a weaker sense than customary. The usual stronger 
version is given in Problem 2. We study it in Volume 2, Chapter 7, §11. 
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Theorem 2. [f V»|I] < +00 and if f is relatively continuous at some p € I 
(over I = [a, |), then the same applies to the length function vy. 


Proof. We consider left continuity first, with a < p< b. 
Let ¢ > 0. By assumption, there is 6 > 0 such that 


\f(z) — f(p)| < 5 when |x — p| < 6 and z € [a, pj. 


Fix any such x. Also, Vyla, p] = supp S(f, P) over [a, p]. Thus 


k 
& 
Vela, p| = S Adsl 
i=1 


for some partition 
P= {lo = Gi iceg tei te = hot ap). (Wi) 


We may assume t,_1 = Z, x as above. (If t,_1 # 2, add x to P.) Then 


E 


Ac fl =IF(”) —f@)1< 5. 


and hence 


k-1 k-1 
é & E 
Vela, p| = 3 < ) |A;f| ae |Axf| < ) Ag f | aE 3 at Vela, tp4| + 3" (1) 
w=1 w=1 


However, 
Vela, p] = ve (p) 


and 
Vela, tei] = Vela, x] = ve (a). 


Thus (1) yields 
lu¢(p) — vp¢(x)| = Vela, p]| — Vela, 2] < € for x € [a, p] with |x —p| < 6. 


This shows that vy is left continuous at p. 
Right continuity is proved similarly on noting that 


vz(x) — v¢(p) = Velp, 6] — Vela, 6] for p< x < b. (Why?) 


Thus vy is, indeed, relatively continuous at p. Observe that vy is also of 
bounded variation on J, being monotone and finite (see Theorem 3(ii) of §7). 


This completes the proof of both Theorem 2 and Theorem 1. 


We also have the following. 
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Corollary 1. If f is real and absolutely continuous on I = |a, b] (weakly), 
so are the nondecreasing functions g and h (f = g —h) defined in Theorem 3 


of 87. 


Indeed, the function g as defined there is simply vy. Thus it is relatively 
continuous and finite on J by Theorem 1. Hence so also is h = f — g. Both are 
of bounded variation (monotone!) and hence absolutely continuous (weakly). 


Note 1. The proof of Theorem 1 shows that (weak) absolute continuity 
implies uniform continuity. The converse fails, however (see Problem 1(iv) 
in §7). 

We now apply our theory to antiderivatives (integrals). 


Corollary 2. [fF = [ f on I = {a, }] and if f is bounded (|f| < .K € E') on 
I—Q (Q countable), then F is weakly absolutely continuous on I. 


(Actually, even the stronger variety of absolute continuity follows. See Chap- 
ter 7, §11, Problem 17). 


Proof. By definition, F = / f is finite and relatively continuous on J, so we 
only have to show that Vr[I] < +00. This, however, easily follows by Problem 3 
of §7 on noting that F’ = f on I —S (S countable). Details are left to the 
reader. 


Our next theorem expresses arc length in the form of an integral. 


Theorem 8. If f: E’ > E is continuously differentiable on I = [a, b] (§6), 
then vs = f |f’| on I and 


b 
Vila, 8) = ff 
Proof. Leta<p<a<b, Ax =2z-—p, and 


Avy = vz (x) — vs(p) = Vylp, x]. (Why?) 
As a first step, we shall show that 


Av 
AY < sup li'l (2) 
e [p,2] 
For any partition P = {p=to, ..., tm ==} of [p, x], we have 


sasti] [p,a 


Sy.P y=) Ags ow |f'| (ti — ti) < sup |f"| Ac. 
4=1 4=1 


Since this holds for any partition P, we have 


Vy [p, 2] < sup |f’| Az, 
[p,x] 


which implies (2). 
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On the other hand, 
Avs = Vs[p, 2] = |f(x) — f(p)| = |AFI. 


Combining, we get 


Te S sup lf!| < +00 (3) 
[p,2] 


rose 
Az|— 
since f’ is relatively continuous on [a, b], hence also uniformly continuous and 


bounded. (Here we assumed a < p < x < b. However, (3) holds also if 
a<ax<p<b, with Av; = —V{[z, p] and Az < 0. Verify!) 


Now 
If’) - lf @)I| < lf’) — f'@)| 70 asx p, 
so, taking limits as x — p, we obtain 
Avs ; 
tim $2 = |f')| 


Thus v¢ is differentiable at each p in (a, 6), with v}(p) = |f’(p)|. Also, v¢ is 
relatively continuous and finite on [a, b] (by Theorem 1).* Hence vs = f[ |f’| 
on |a, b], and we obtain 


b 
/ | f’| = ve(b) — v¢(a) = Vela, DJ, as asserted. (4) 


Note 2. If the range space FE’ is E” (*or C”), f has n components 


fis far -++5 fn 
By ‘Theorem & in §1, f° = (fi, fo; -=+5 Sp) 5 80 


M1 = 4/0 |e 
k=1 


nm b 7) 
> Ces / > |fi(t)|? dt (classical notation). (5) 
k=1 @ V k=1 


and we get 


In particular, for complex functions, we have (see Chapter 4, §3, Note 5) 


b 
Vjla, = | “(02 + fi,(t)? dt. (6) 


In practice, formula (5) is used when a curve is given parametrically by 
te= felt), KH 1, 2) .205%; 


? Note that (3) implies the finiteness of v¢(p) and v¢(z). 
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with the f; differentiable on [a, b]. Curves in E? are often given in nonpara- 
metric form as 
y=F(a), F:E' > E’. 


Here FI] is not the desired curve but simply a set in E+. To apply (5) here, 
we first replace “y = F(x)” by suitable parametric equations, 


a= filt) and y = fa(t); 


i.e., we introduce a function f: E' > E, with f = (fi, fe). An obvious (but 
not the only) way of achieving it is to set 


n= filt)=tand y= fa(t) = F(t) 
so that f; = 1 and fS = F’. Then formula (5) may be written as 


b 
Vela, 5) = / V1+F'(a)?dz, f(c)=(@, F(s)). (7) 


Example. 
Find the length of the circle 


ety? =r. 
Here it is convenient to use the parametric equations 
2c=f7 cost and y= rsing, 
ie., to define f: E! > E? by 
f(t) = (cost, ¢sin?), 
or, in complex notation, 
f(t)=re". 
Then the circle is obtained by letting t vary through [0, 27]. Thus (5) 
yields 


b b 
V,([0, an] = [ rVeos? t+ sin®tdt =r [ Ldt= rt 


Note that f describes the same circle A = f[I| over I = [0, 47]. More 
generally, we could let t vary through any interval [a, b] with b-—a > 
27. However, the length, Vy[a, 6], would change (depending on b — a). 
This is because the circle A = f[I] is not a simple arc (see §7, Note 1), 
so £A depends on f and J, and one must be careful in selecting both 
appropriately. 


20 
= 277: 
0 
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Problems on Absolute Continuity and Rectifiable Arcs 


1. 
=>2. 


Complete the proofs of Theorems 2 and 38, giving all missing details. 
Show that f is absolutely continuous (in the weaker sense) on |[a, 6] if 
for every € > 0 there is 6 > 0 such that 
> | f (ts) — f(s;)| < € whenever SG — s;) <6 and 
i=1 i=1 
a< 81 <t) <8) < te < +++ < Sy <ty <b. 


(This is absolute continuity in the stronger sense.) 


. Prove that vy is strictly monotone on [a, }] iff f is not constant on any 


nondegenerate subinterval of |a, 0]. 
[Hint: If « < y, Ve[x, y] > 0, by Corollary 4 of §7]. 


. With f, g, h as in Theorem 2 of 87, prove that if f, g, h are absolutely 


continuous (in the weaker sense) on J, so are f +g, hf, and |f|; so also 
is f/h if (de > 0) |h| > e on I. 


. Prove the following: 


(i) If f’ is finite and 4 0 on I = [a, 8], so also is vy (with one-sided 
derivatives at the endpoints of the interval); moreover, 

f' 

ail 

“ 

Thus show that f’/v’ is the tangent unit vector (see §1). 


=lonl. 


(ii) Under the same assumptions, fF = f o uF" is differentiable on 
J = [0, v¢(b)| (with one-sided derivatives at the endpoints of the 
interval) and FJ] = f[I]; i.c., F and f describe the same simple 
arc, with Vp[I] = Ve{[J]. 

Note that this is tantamount to a change of parameter. Setting 
s=vy(t),ie, t= v;"(s), we have f(t) = f(v7*(s)) = F(s), with 
the arclength s as parameter. 


§9. Convergence Theorems in Differentiation and Integration 


Given 


Py = | foot Fy = fos {ae ee eee 


what can one say about flim f, or (lim F,,)’ if the limits exist? Below we give 
some answers, for complete range spaces F’ (such as E”). Roughly, we have 
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lim FY, = (lim F,,)’ on I — Q if 
(a) {F,(p)} converges for at least one p € I and 
(b) {FY} converges uniformly. 


Here J is a finite or infinite interval in E! and Q is countable. We include in 
Q the endpoints of I (if any), so I — Q C I® (= interior of I). 


Theorem 1. Let F,,: E' > E (n=1, 2, ...) be finite and relatively continu- 
ous on I and differentiable on I — Q. Suppose that 


(a) limp+oo Fn(p) exists for some p € I; 
(b) FY + f # +co (uniformly) on J — Q for each finite subinterval J C I; 
(c) E is complete. 
Then 
(i) limp soo Fr = F exists uniformly on each finite subinterval J C I; 
(ii) F=f f on I; and 
(ii) (im, ) =i = 7 = lim, +6 hf), ont =. 
Proof. Fix ¢ > 0 and any subinterval J C I of length 6 < oo, with p € J (p 


as in (a)). By (b), F’ — f (uniformly) on J — Q, so there is a k such that for 
m,n>k, 


Fn) -FQ1<5, teJ-Q; (1) 
hence 
sup |Fi,(t) —Fy(Q)| Se. (Why?) (2) 
teJ—-Q 


Now apply Corollary 1 in §4 to the function h = F,, — F, on J. Then for 
each x € J, |h(x) — h(p)| < M|x — p|, where 


M < sup |h'(t)|<e 
teJ—-Q 


by (2). Hence for m,n >k, x € J and 
|Fim(@) — Fn(@) — Fm(p) + Fn(p)| < ela — pl < €6. (3) 
As € is arbitrary, this shows that the sequence 
{Fn — Fn(p)t 


satisfies the uniform Cauchy criterion (Chapter 4, §12, Theorem 3). Thus as E 
is complete, {F,, — F,(p)} converges uniformly on J. So does {F,,}, for {F,(p)} 
converges, by (a). Thus we may set 


F =lim F,, (uniformly) on J, 
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proving assertion (i).1 

Here by Theorem 2 of Chapter 4, §12, F' is relatively continuous on each 
such J C J, hence on all of I. Also, letting m — +00 (with n fixed), we have 
Fi, — F in (3), and it follows that for n > k and x € G,(6) NI. 


|F (x) — Fr(x) — Fp) + Fn(p)| < ele — p| < €6. (4) 


Having proved (i), we may now treat p as just any point in J. Thus formula 
(4) holds for any globe G,(6), p € I. We now show that 


Fi=font-Qiie, P= [ fonl. 


Indeed, if p € I — Q, each F,, is differentiable at p (by assumption), and 
p € I° (since I — Q C I® by our convention). Thus for each n, there is 6, > 0 
such that 


AFn “(p)) = |= t) — Fn(p) 5) 


=p |< 
ae n(P) 


Noe Baa) 


for all oS Gagl On) Gyn) Ct. 
By assumption (b) and by (4), we can fix n so large that 


IF/(p) — f()| < = 


2 
and so that (4) holds for 6 = 46,. Then, dividing by |Az| = |x — p|, we have 
AF AF, 
Ac Az 


amas with (5), we infer that for each e > 0, there is 6 > 0 such that 
(»)| < =] AF, orn AF, 
= AG 


’(2)|-+1Fa(p)—f(p)| < 2¢, @ € Gp (6). 


This shows that 


ie., F’ = f on I—Q, with f finite by assumption, and F finite by (4). As F 
is also relatively continuous on J, assertion (ii) is proved, and (iii) follows since 
P=lmr, and f=lmr. O 


Note 1. The same proof also shows that F;,, > F (uniformly) on each closed 
subinterval J C J if FY > f (uniformly) on J — Q for all such J (with the 
other assumptions unchanged). In any case, we then have F,, — F' (pointwise) 
on all of J. 


We now apply Theorem 1 to antiderivatives. 


1 Indeed, any J can be enlarged to include p, so (3) applies to it. Note that in (3) we may 
as well vary x inside any set of the form IM G,(0). 
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Theorem 2. Let the functions f,: E! > E,n = 1,2,..., have antideriva- 
tives, F, = [ fn, on I. Suppose E is complete and fr > f (uniformly) on 
each finite subinterval J C I, with f finite there. Then | f exists on I, and 


fr-f lim fn = Jim, [fy for any p, 2 € I (6) 


Proof. Fix any p € I. By Note 2 in 85, we may choose 
F(a) =i fn for x € I. 
P 


Then F,,(p) = i, fn = 9, and so limn+oo Fn(p) = 0 exists, as required in The- 
orem l(a). 

Also, by definition, each F;, is relatively continuous and finite on J and 
differentiable, with F” = f,, on I — Qn. The countable sets Q,, need not be 
the same, so we replace them by 


Q= U Qn 
n=1 


(including in Q also the endpoints of J, if any). Then Q is countable (see 
Chapter 1, §9, Theorem 2), and J—Q C I —Qn, so all F,, are differentiable 
on I — Q, with F’ = f, there. 


Additionally, by assumption, 


fn 2 f (uniformly) 


on finite subintervals J C J. Hence 
F’ + f (uniformly) on J — Q 


for all such J, and so the conditions of Theorem 1 are satisfied. 
By that theorem, then, 


f= ft = lim F,, exists on I 


and, recalling that 


F,(2) = / te 


we obtain for x € I 


a f = F(a) — F(p) = lim F,, (2) — lim F,,(p) = lim F, (x) — 0 = tim fo Tus 


As p € I was arbitrary, and f = lim f, (by assumption), all is proved. 
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Note 2. By Theorem 1, the convergence 


[nope (i.e., F, > F) 


is uniform in x (with p fixed), on each finite subinterval J C J. 
We now “translate” Theorems 1 and 2 into the language of series. 


Corollary 1. Let E and the functions F,: E‘ + E be as in Theorem 1. 
Suppose the series 
S> Fr(p) 


converges for some p € I, and 
dF 
converges uniformly on J — Q, for each finite subinterval J C I. 
Then >> F,, converges uniformly on each such J, and 


= yo 
n=1 


is differentiable on I — Q, with 
CO / CO 
= (> Fr] = FY, there. (7) 
n=1 n—-1 


In other words, the series can be differentiated termwise. 


Proof. Let 
= Fy WD ce 
k=1 


be the partial sums of 5* F,. From our assumptions, it then follows that the 
Sy, satisfy all conditions of Theorem 1. (Verify!) Thus the conclusions of Theo- 
rem 1 hold, with F,, replaced by sy. 

We have F' = lims,, and F” = (lims,,)’ = lims{,, whence (7) follows. O 


Corollary 2. If E and the f, are as in Theorem 2 and if S> fp converges 
uniformly to f on each finite interval J CI, then [ f exists on I, and 


[is -[Sn-> Sf fa for any p, 2 eT. (8) 
Pp Pp 


n=1 n=1"P 


Briefly, a uniformly convergent series can be integrated termwise. 
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Theorem 3 (power series). Let r be the convergence radius of 
So an (a —p)", an € E, pe E'. 
Suppose E is complete. Set 


=) ae py onl =(p—r, ptr). 


Then the following are true: 


(i) f is differentiable and has an exact antiderivative on I. 


= one =P ae ond [f= yee a ee TF, 


(iii) r is also the convergence radius of the two series in (ii). 


(iv) > An(xz —p)” is exactly the Taylor series for f(x) on I about p. 


Proof. We prove (iii) first. 
By Theorem 6 of Chapter 4, §13, r = 1/d, where 


d=lim 7/a,. 
Let r’ be the convergence radius of S> na,(x — p)"~+, so 
r= ; with d’ = lim %/nap. 
However, lim 7/n = 1 (see §3, Example (e)). It easily follows that 
d =lim %/na, =1-lim v/a, = 
Hence r’ = 1/d’ =1/d=r. 
The convergence radius of Se: 


(iii) is proved. 
Next, let 


ert 


(x —p is determined similarly. Thus 


an 
n+ 1 


Then the F,, are differentiable on J, with F’ = f, there. Also, by Theorems 6 
and 7 of Chapter 4, 813, the series 


pe =} /an(x — p) 


? For a proof, treat d and d’ as subsequential limits (Chapter 4, §16, Theorem 1; Chapter 2, 
§13, Problem 4). 


fale) =G,(e—p)” and Fy lz) = @—p)?™ n= 0,1, 2,25.. 
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converges uniformly on each closed subinterval J C I = (p—r, p+r).° Thus 
the functions F;, satisfy all conditions of Corollary 1, with Q = @, and the f, 
satisfy Corollary 2. By Corollary 1, then, 


ea 
n=1 
is differentiable on J, with 
Fig)= >) Fi) = > an(e—p)” = f@) 
n=1 n=1 


for all x € I. Hence F is an exact antiderivative of f on J, and (8) yields the 
second formula in (ii). 
Quite similarly, replacing F;, and F' by f, and f, one shows that f is differ- 
entiable on J, and the first formula in (ii) follows. This proves (i) as well. 
Finally, to prove (iv), we apply (i)—(iii) to the consecutive derivatives of f 
and obtain 


[oe 


f (a) = Si n(n = 1) 3 -(n —k+ l)an(x =p 


nk 
foreach x €lT andkeN. 


If x = p, all terms vanish except the first term (n = k), ie., k!ay. Thus 
f® (p) = klax, k € N. We may rewrite it as 


Jp 


n! 


~ WM=0, 1y 2. sae, 


n 


since f) (p) = f(p) = ao. Assertion (iv) now follows since 


= CO £(n) 
f(z) = =, an(x —p)” = >» Pw —p)", «x €T, as required. 
n=0 n=0 : 


Note 3. If S$) a,(a — p)” converges also for x = p—r or x =p+r, so does 


the integrated series 
n+1 


(x — p) 
dan n+1 


since we may include such x in J. However, the derived series )* nan (x —p 
need not converge at such x. (Why?) For example (see §6, Problem 9), the 
expansion 


ee 


x gt 


In(1 pe foe a titer 
n(l+z2)=2 a Fg 


3 For our present theorem, it suffices to show that it holds on any closed globe J = Gp(6), 
56 <r. We may therefore limit ourselves to such J (see Note 1). 
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converges for x = 1 but the derived series 
l-r+2?-—.-.. 


does not. 

In this respect, there is the following useful rule for functions f: E! + E™ 
Cro™). 
Corollary 3. Let a function f: E‘ 3 E™ (*C™) be relatively continuous on 
[p, to] (or [xo, pl), to A p.* If 


f(z) = » an(x —p)” forp <x < 2 (respectively, 29 <x <p), 
n=0 
and if S>an(xo — p)” converges, then necessarily 


f (20) = > An(Xo =p)" 
n=0 


The proof is sketched in Problems 4 and 5. 


Thus in the above example, f(x) = In(1+ 2) defines a continuous function 
on [0, 1], with 


f(a) = S(-1)""~ on (0, 1), 


We gave a direct proof in 86, Problem 9. However, by Corollary 3, it suffices 
to prove this for [0, 1), which is much easier. Then the convergence of 


love) = m— 1 
a 


yields the result for x = 1 as well. 


Problems on Convergence in Differentiation and Integration 


1. Complete all proof details in Theorems 1 and 3, Corollaries 1 and 2, and 
Note 3. 


2. Show that assumptions (a) and (c) in Theorem 1 can be replaced by 
F, > F (pointwise) on I. (In this form, the theorem applies to incom- 
plete spaces E as well.) 


[Hint: F;, + F (pointwise), together with formula (3), implies F, — F (uniformly) 
on I.] 


4 Relative continuity at xg suffices. 
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. Show that Theorem 1 fails without assumption (b), even if F, > F 


(uniformly) and if F is differentiable on J. 
[Hint: For a counterexample, try F,(x) = + sinnz, on any nondegenerate I. Verify 
that F, — 0 (uniformly), yet (b) and assertion (iii) fail.] 


. Prove Abel’s theorem (Chapter 4, §13, Problem 15) for series 


> anle — 7)”, 


with all a, in E™ (‘or in C™) but with x, p € E?. 


[Hint: Split an(x — p)” into components.] 


. Prove Corollary 3. 


[Hint: By Abel’s theorem (see Problem 4), we may put 


CO 


> an (a — p)" = F(a) 


n=0 


uniformly on [p, xo] (respectively, [xo, p]). This implies that F is relatively contin- 
uous at x9. (Why?) So is f, by assumption. Also f = F on [p, xo) ((ao, pl). Show 
that 


f(wo) = lim f(e) = lim F(e) = F (eo) 


as x — xo from the left (right).] 


. In the following cases, find the Taylor series of F about 0 by integrating 


the series of F’. Use Theorem 3 and Corollary 3 to find the convergence 
radius r and to investigate convergence at —r and r. Use (b) to find a 
formula for 7. 


(a) F(x) =In(1+2); 
(ob) Pig) = arebane: 


(c) F(x) = arcsin x. 


. Prove that 


* In(1 — t) a” 
[e-y5 for ¢< |=1, 4); 


[Hint: Use Theorem 3 and Corollary 3. Take derivatives of both sides.] 


§10. Sufficient Condition of Integrability. Regulated Functions 


In this section, we shall determine a large family of functions that do have 
antiderivatives. First, we give a general definition, valid for any range space 
(T, p) (not necessarily EL). The domain space remains E1. 
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Definition 1. 


A function f: E+ > (T, p) is said to be regulated on an interval IJ C E’, 
with endpoints a < b, iff the limits f(p~) and f(p*), other than +ov,! 
exist at each p € I. However, at the endpoints a, b, if in I, we only 
require f(a) and f(b~) to exist. 


Examples. 
(a) If f is relatively continuous and finite on J, it is regulated. 


(b) Every real monotone function is regulated (see Chapter 4, §5, Theorem 1). 


(c) If f: E! — E” (*C”) has bounded variation on J, it is regulated (87, 
Theorem 4).? 


(d) The characteristic function of a set B, denoted Cg, is defined by 
Cpa(x) = 1if x € Band Cg =0 on —B. 


For any interval J C E', Cy is regulated on E?. 


(e) A function f is called a step function on I iff I can be represented as the 
union, J = U, Jy, of a sequence of disjoint intervals [;, such that f is con- 
stant and 4 too on each J. Note that some I, may be singletons, {p}.° 

If the number of the J; is finite, we call f a simple step function. 
When the range space T is £, we can give the following convenient 
alternative definition. If, say, f = a, 4 +00 on Jz, then 


f= > acy, on 1m 
k 


where C7, is as in (d). Note that }°, a,Cz,(x) always exists for disjoint 
Each simple step function is regulated. (Why?) 


Theorem 1. Let the functions f, g, h be real or complex (or let f, g be vector 
valued and h scalar valued). 

If they are regulated on I, so are f +g, fh, and |f|; so also is f/h if h is 
bounded away from 0 on I, t.e., (de > 0) |h| > on I. 


The proof, based on the usual limit properties, is left to the reader. 
We shall need two lemmas. One is the famous Heine—Borel lemma. 


1 This restriction is necessary in integration only, in the case T = E! or T = E*. 
2 Actually, this applies to any f: E! > E, with E complete and VI] < +00 (Problem 7). 
3 The endpoints of the I;, may be treated as such degenerate intervals. 
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Lemma 1 (Heine—Borel). If a closed interval A = [a, b] in E‘ (or E”) is 
covered by open sets G; (i € I), i.e., 


ACUG, 
i€l 
then A can be covered by a finite number of these G;. 
The proof was sketched in Problem 10 of Chapter 4, 86. 


Note 1. This fails for nonclosed intervals A. For example, let 
1 
A= (0,1) C E' and G, = (<. 1). 
n 


Then - - 
A= |) Gp (verify!), but not AC [J Gn 
n=] 


3 
II 
mn 


for any finite m. (Why?) 
The lemma also fails for nonopen sets G;. For example, cover A by singletons 
{x}, 2 € A. Then none of the {x} can be dropped! 


Lemma 2. If a function f: E' > T is regulated on I = {a, b], then f can be 
uniformly approximated by simple step functions on I. 

That is, for any « > 0, there is a simple step function g, with p(f, g) <« 
on I; hence 


ee e(f(z), g(z)) <e. 


Proof. By assumption, f(p~) exists for each p € (a, 6], and f(pt) exists for 
p € |a, 6), all finite. 

Thus, given e > 0 and any p € J, there is G,(6) (6 depending on p) such 
that p(f(x), r) < © whenever r = f(p ) and xz € (p—4, p), and p(f(x), s) <e 
whenever s = f(pt) and x € (p, p+ 6); re I. 

We choose such a G(d) for every p € I. Then the open globes Gy = G,(d) 
cover the closed interval I = |a, b], so by Lemma 1, I is covered by a finite 
number of such globes, say, 


LE L) Gp, (x); EG ho i= ie <2 yO 
k=1 


We now define the step function g on I as follows. 
If x = px, we put 
On) =Tlpel, RH 1,23 265 
If x € [a, pi), then 
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Ifxe (pi, pit 1), then 
g(x) = f (py). 


More generally, if x is in Gp, (6,) but in none of the Gp, (d;), 7 < k, we put 
g(t) = f(p_) ike < pe 


and 
g(x) = f(pg) if x > pp. 
Then by construction, p(f, g) < ¢ on each Gp,, hence on I. O 


“Note 2. If T is complete, we can say more: f is regulated on I = [a, }] iff 
f is uniformly approximated by simple step functions on I. (See Problem 2.) 


Theorem 2. /f f: E' > E is regulated on an interval I C E! and if E is 
complete, then [ f exists on I, exact at every continuity point of f in I°. 
In particular, all continuous maps f: E1 + E” (*C™) have exact primitives. 


Proof. In view of Problem 14 of §5, it suffices to consider closed intervals. 
Thus let J = [a,b], a < 6b, in 

E'. Suppose first that f is the char- Y, 
acteristic function Cy of a subinter- 
val J C I with endpoints c and d 
(a= 6d <b), 66 7 = 1 on J, 
and f = 0 on I — J. We then define - 
P(e) = 2 on J, f =< on-|a, ¢),and 
F =d on {d, b] (see Figure 25). Thus 
F is continuous (why?), and F’ = f 
on, T— {a, b, C, d} (why’?). Hence FIGURE 25 
F = [ f on; i.e., characteristic func- 

tions are integrable. 


| 
| 
| 
| 
| 
O' ae db xX 


Then, however, so is any simple step function 


f= >. arch, » 
k=1 


by repeated use of Corollary 1 in §5.+ 
Finally, let f be any regulated function on J. Then by Lemma 2, for any 
é,= +, there is a simple step function g, such that 


sup lgn(2) — f(2)| < — 


= SD) sees 
vel n 


As 4 — 0, this implies that g, — f (uniformly) on I (see Chapter 4, §12, 
Theorem 1). Also, by what was proved above, the step functions g, have 


4 The corollary applies here also if the a, are vectors (Cr, is scalar valued). 
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antiderivatives, hence so has f (Theorem 2 in §9);i., F = f f exists on J, as 
claimed. Moreover, f f is exact at continuity points of f in I° (Problem 10 in 


§5). 


In view of the sufficient condition expressed in Theorem 2, we can now re- 
place the assumption “{ f exists” in our previous theorems by “f is regulated” 
(provided E is complete). For example, let us now review Problems 7 and 8 
in §5. 


Theorem 3 (weighted law of the mean). Let f: E' + E (E complete) and 
g: E' + E? be regulated on I = [a, b], with g > 0 on I.° Then the following 
are true: 


(i) There is a finite c € E (called the “g-weighted mean of f on I”) such 
that of = cfg. 

(ii) If f, too, is real and has the Darboux property on I, then c = f(q) for 
some qe. 


Proof. Indeed, as f and g are regulated, so is gf by Theorem 1. Hence by 
Theorem 2, [ f and [gf exist on J. The rest follows as in Problems 7 and 8 
of §5. 


Theorem 4 (second law of the mean). Suppose f and g are real, f is monotone 
with f = f[ f’ on I, and g is regulated on I; I = {a, b]. Then 


[10-50 [9450 [4 for someger (1) 


Proof. To fix ideas, let ft; ie., f’ > 0 on I. 
The formula f = { f’ means that f is relatively continuous (hence regulated) 
on IJ and differentiable on J — Q (Q countable). As g is regulated, 


[ 9-6) 


does exist on I, so G has similar properties, with G(a) = e g=0. 


By Theorems 1 and 2, [ fG’ = f fg exists on J. (Why?) Hence by 
Corollary 5 in §5, so does [ Gf’, and we have 


a 


Now G has the Darboux property on J (being relatively continuous), and 


5 One can also assume g < 0 on J; in this case, simply apply the theorem to —g. 


810. Sufficient Condition of Integrability. Regulated Functions 327 
f’ >0. Also, {Gand f[ Gf’ exist on I. Thus by Problems 7 and 8 in §5, 


for-o af r=o@) f(a)|. 


Combining all, we obtain the required result (1) since 


| ta= #60) - i Gf 


= F()G(b) — FO)G@) + f(aG(q) 


= 10) [0+ 80) fs 


We conclude with an application to infinite series. Given f: E' > E, we 


define a P a 
/ f= lim / f and / j= jim wf 
a w—+00 a =e —co 


if these integrals and limits exist. 
We say that i f and a f converge iff they exist and are finite. 


y eT 


Theorem 5 (integral test of convergence). If f: E1 > E! is nonnegative and 
nonincreasing on I = |a, +00), then 


[ f converges iff SS f(n) does. 
¢ n=1 


Proof. As f|, f is regulated, so f{ f exists on I = [a, +00). We fix some 


natural k > a and define 
1) =| f fore I. 
k 


By Theorem 3(iii) in 85, Ft on J. Thus by monotonicity, 


lim F(x)= lim [is =) f 
x%—+oo @%—-+00 


exists in E*; so does i. f. Since 


"a gee 
[oa 


where pe f is finite by definition, we have 


ff < +00 iff i: f < +00. 
a k 
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Similarly, 


So fn) < +00 iff SO f(n) < +00. 


n=k 


Thus we may replace “a” by “k.” 
Let 
=e, MSH ees ours 


and define two step functions, g and h, constant on each J,,, by 
h=f(n) and ¢ = f(n+1) on I,, n= F. 


Since f|, we have g < f <h on all I, hence on J = [k, +00). Therefore, 


fosfrsf h for x € J. 
k k k 


Also, 


since h = f(n) (constant) on [n, n+ 1), and so 


n+1 n+l1 n+1 
i. hx) de = f(n) | dx = f(n)- 2] | = f(n)(n+1—n) = f(n) 
Similarly, 
fo s-Sspesy= Ys 
k n=k n=k+1 


Thus we obtain 


Y siy= fas [rs [n= F p09 


or, letting m — ov, 


a f(a) < | fs) fn) 


n=k+1 


Hence ia f is finite iff > f(n) is, and all is proved. 
n=1 
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Examples (continued). 


(f) Consider the hyperharmonic series 


1 
s s (Problem 2 of Chapter 4, $13). 


Let 


If p = 1, then f(x) =1/z, so fy f =Inz 4 +00 as t + +00. Hence 
>> 1/n diverges. 
If p £1, then 


oo girP |x 
= lim = lim 
| f lim {= t%—+oo 1 —p 1? 
Se) tae f converges or diverges according as p > 1 or p < 1, and the same 
applies to the series )>1/n?. 


(g) Even nonregulated functions may be integrable. Such is Dirichlet’s func- 
tion (Example (c) in Chapter 4, §1). Explain, using the countability of 
the rationals. 


Problems on Regulated Functions 


In Problems 2, 5, 6, and 8, we drop the restriction that f(p~) and f(pt) are 
finite. We only require them to exist in (T, p). If T = E*, a suitable metric 
for E* is presupposed. 


1. Complete all details in the proof of Theorems 1-3. 
1’ Explain Examples (a)-(g). 
*2. Prove Note 2. More generally, assuming JT to be complete, prove that if 
gn > f (uniformly) on I = |a, 0] 


and if the g, are regulated on I, so is f. 
[Hint: Fix p € (a, b]. Use Theorem 2 of Chapter 4, §11 with 


x = [a, pl, Y = NU {+oo}, q= +00, and F(a, n) => gn(a). 
Thus show that 
f(p-) = lim lim gp (x) exists; 
x2—p- Noo 
similarly for f(pt).] 


3. Given f, g: E' > E’, define f Vg and f Ag as in Problem 12 of Chap- 
ter 4, 88. Using the hint given there, show that f Vg and f Ag are 
regulated if f and g are. 
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. Show that the function go f need not be regulated even if g and f are. 


[Hint: Let 
oer = a= = and FO) =00) = Oi T= [641 


Proceed.| 


Given f: E' > (T, p), regulated on I, put 


j(p) = max{p(f(p), f(P~)), p(F(P), F(v*)), e(f("), F@*)) fs 
call it the jump at p. 
(i) Prove that f is discontinuous at p € I° iff j(p) > 0, i-e., iff 


(Qn€N) slp) >= 


(ii) For a fixed n € N, prove that a closed subinterval J C J contains 
at most finitely many x with j(x) > 1/n. 


[Hint: Otherwise, there is a sequence of distinct points tm € J, j(%m) > i 
hence a subsequence &m, — p € J. (Why?) Use Theorem 1 of Chapter 4, §2, 
to show that f(p—) or f(p*) fails to exist.] 


Show that if f: E+ > (7, p) is regulated on J, then it has at most count- 
ably many discontinuities in J; all are of the “jump” type (Problem 5). 
[Hint: By Problem 5, any closed subinterval J C I contains, for each n, at most 
finitely many discontinuities « with j(z) > 1/n. Thus for n = 1, 2,..., obtain 
countably many such 2.] 


. Prove that if E is complete, all maps f: E! > E, with V;[I] < +00 on 


I = |a, 6], are regulated on J. 
(Hint: Use Corollary 1, Chapter 4, 82, to show that f(p—) and f(pt) exist. 
Say, 
In >pwithan<p (an, pe), 
but {f(an)} is not Cauchy. Then find a subsequence, {xn, }¢, and ¢ > 0 such that 


Fang) —F On) Se: = 1 8, O vss. 


Deduce a contradiction to V+ [I] < +00. 


Provide a similar argument for the case zp, > p.] 


. Prove that if f: E' > (T, p) is regulated on J, then f[B] (the closure 


of f[B]) is compact in (T, p) whenever B is a compact subset of I. 


[Hint: Given {zm} in f[B], find {ym} C f[B] such that p(zm, ym) — 0 (use 
Theorem 3 of Chapter 3, §16). Then “imitate” the proof of Theorem 1 in Chap- 
ter 4, 88 suitably. Distinguish the cases: 


(i) all but finitely many zm are < p; 
(ii) infinitely many rm exceed p; or 


(iii) infinitely many zm, equal p.] 
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§11. Integral Definitions of Some Functions 


By Theorem 2 in §10, [ f exists on J whenever the function f: E! > E is 
regulated on J, and E is complete. Hence whenever such an f is given, we can 
define a new function F' by setting 


refs 


on I for some a € I. This is a convenient method of obtaining new continuous 
functions, differentiable on J—Q (Q countable). We shall now apply it to obtain 
new definitions of some functions previously defined in a rather strenuous step- 
by-step manner. 


I. Logarithmic and Exponential Functions. From our former defini- 
tions, we proved that 


sa 
ne = [ —dt, x>0. 
1 t 
Now we want to treat this as a definition of logarithms. We start by setting 
f(t) ==, tek, 70, 


and f(0) = 0. 

Then f is continuous on J = (0, +00) and J = (—on, 0), so it has an exact 
primitive on J and J separately (not on E+). Thus we can now define the log 
function on I by 


ae | 
/ ri dt = log x (also written Inz) for x > 0. (1) 
1 


By the very definition of an exact primitive, the log function is continuous 
and differentiable on J = (0, +00); its derivative on I is f. Thus we again have 
the symbolic formula 


1 
(logx)’=-, ax>O. 
x 
If « < 0, we can consider log(—z). Then the chain rule (Theorem 3 of §1) 
yields 
il 
(log(—a:))’ = = (Verify!) 


Hence 1 
(log |x|)’ = = for x # 0. (2) 


Other properties of logarithms easily follow from (1). We summarize them 
now. 
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Theorem 1. 
zl 
(i) logl = / —dt = 0. 
7 t 
(ii) loga < logy whenever0 <a <y. 
ii) lm = d lim | = —0Oo. 
(iii) lim logs +oo an Jim, log x ee 
(iv) The range of log is all of E?. 
(v) For any positive x, y € E’, 


log(xy) = logx + logy and log (=) = logx — logy. 


(vi) loga”=r-loga,a>0,reEN. 


1\n 
(vii) loge = 1, where e = lim (1 + — | : 


n> Cco 
Proof. 
(ii) By (2), (loga)’ > 0 on I = (0, +00), so log z is increasing on I. 
(iii) By Theorem 5 in §10, 


sae | 
lim loge = f 7 di = +00 
i 


x%—->+00 
since 


=-+0oo (Chapter 4, 813, Example (b)). 


Slr 


n=1 
Hence, substituting y = 1/x, we obtain 

lim logy= lim log—-. 
yor ey «r—> +00 6 x 


However, by Theorem 2 in 85 (substituting s = 1/t), 


Thus 


1 
lim logy= lim log—=— lim logr =— 
oe ee eee 


as claimed. (We also proved that log + = — log.) 


(iv) Assertion (iv) now follows by the Darboux property (as in Chapter 4, 89, 
Example (b)). 
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(v) With z, y fixed, we substitute t = xs in 


and obtain 


1 

= —log—+ logy 
ie 

= logx + logy. 


Replacing y by 1/y here, we have 
x 1 
log — = logx + log — = logz — logy. 
y ] 


Thus (v) is proved, and (vi) follows by induction over r. 
(vii) By continuity, 


LN log(1 +1 
loge = lim log x — lim log (1 as =) = ‘li og( ae pay 
re noo n noo 1/n 


where the last equality follows by (vi). Now, L’H6pital’s rule yields 


. log(1+2) 
lim Om 
x20 iG eo-0l+ean 


= aly 


Letting x run over 4 — 0, we get (vii). O 


Note 1. Actually, (vi) holds for any r € E', with a” as in Chapter 2, 
8811-12. One uses the techniques from that section to prove it first for rational 
r, and then it follows for all real r by continuity. However, we prefer not to use 
this now. 

Next, we define the exponential function (“exp”) to be the inverse of the 
log function. This inverse function exists; it is continuous (even differentiable) 
and strictly increasing on its domain (by Theorem 3 of Chapter 4, §9 and 
Theorem 3 of Chapter 5, §2) since the log function has these properties. From 
(log x)’ = 1/ax we get, as in 82, 


(expx)’ =expzx (cf. §2, Example (B)). (3) 


The domain of the exponential is the range of its inverse, i.e., E+ (cf. Theo- 
rem l(iv)). Thus exp z is defined for all 2 € E+. The range of exp is the domain 
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of log, i.e., (0, too). Hence expx > 0 for all x € E?. Also, by definition, 


exp(loga) =a for a > 0, (4) 
exp 0 = 1 (cf. Theorem 1(i)), and (5) 
expr =e’ forre N. (6) 


Indeed, by Theorem 1(vi) and (vii), loge” = r- loge = r. Hence (6) follows. 
If the definitions and rules of Chapter 2, 8811-12 are used, this proof even 
works for any r by Note 1. Thus our new definition of exp agrees with the old 
one. 

Our next step is to give a new definition of a”, for any a, r € E' (a > 0). 
We set 


a” = exp(r- loga) or (7) 
loga”=r-loga (ré€E’). (8) 


In case r € N, (8) becomes Theorem I(vi). Thus for natural r, our new 
definition of a” is consistent with the previous one. We also obtain, for a, b > 0, 


ave: ae @): ¢'=ad@: (n2eF), (9) 
The proof is by taking logarithms. For example, 
log(ab)" = rlogab = r(loga + logb) = r-loga+r-logb 
= loga” + logb" = log(a"b’). 
Thus (ab)” = ab". Similar arguments can be given for the rest of (9) and other 


laws stated in Chapter 2, §§11—12. 


We can now define the exponential to the base a (a > 0) and its inverse, log,, 
as before (see the example in Chapter 4, §5 and Example (b) in Chapter 4, §9). 
The differentiability of the former is now immediate from (7), and the rest 
follows as before. 


II. Trigonometric Functions. These shall now be defined in a precise 
analytic manner (not based on geometry). 

We start with an integral definition of what is usually called the principal 
value of the arcsine function, 


. 1 
arcsin 2 = ——— dt. 
LW 
We shall denote it by F(x) and set 
1 
2) = ———— on I = (-1, 1). 
f(a) = az on T= (-1, 1) 


(F = f =0o0n E' —I.) Thus by definition, F = f f on J. 
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Note that { f exists and is exact on IJ since f is continuous on J. Thus 
1 
F' (a) = f(s) = — > 0 fore € J, 
(@) =f) = zs 
and so F' is strictly increasing on I. Also, F'(0) = i, i= 
We also define the number 7 by setting 


= 2aresin yd = 2F() =2 fs e= fs. (10) 


Then we obtain the following theorem. 


Theorem 2. F' has the limits 
FO") = . and F(-1T) = = 


Thus F becomes relatively continuous on I = [—1, 1] if one sets 


F(1) = > and F(-1) = -5, 


arcsin 1 = and arcsin(—1) = ->. (11) 
xv Cc x 1 
-[r-[ie fn fh 
0 0) c 


By substituting s = 1 —?? in the last integral and setting, for brevity, y = 


V1— x2, we obtain 


Proof. We have 


ae) Foes f Fass = FQ) FW). (Verify!) 


Now as « + 17, we have y = V1— 2x? > 0, and hence F(y) + F(0) = 0 (for 
F is continuous at 0). Thus 


F(I7) = lim F(n pati (s+ fo 1) =-[t+r@=2f t=5 


Similarly, one gets F(—11) = —71/2. 


The function F' as redefined in Theorem 2 will be denoted by It is 
a primitive of f on the closed interval I (exact on J). Thus Fo(zx =a Ie 
—1 <2 <1, and we may now write 


Za fpmar=f s+ fr ft 
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Note 2. In classical analysis, the last integrals are regarded as so-called 
improper integrals, i.e., limits of integrals rather than integrals proper. In our 
theory, this is unnecessary since Fp is a genuine primitive of f on I. 

For each integer n (negatives included), we now define F,,: E' + E+ by 


F,, (2) = nx + (—1)" F(z) for x € I = [-1, 1], 


= 12 
F,, =0 on — I. oa 


F,, is called the nth branch of the arcsine. Figure 26 shows the graphs of Fo 
and F (that of F, is dotted). We now obtain the following theorem. 


Theorem 3. 


(i) Each F,, is differentiable on I = (—1,1) and relatively continuous on 
T= [-1, 1]. 


(ii) F, is increasing on I ifn is even, and decreasing if n is odd. 
ale 

V1— 2x? 
1 


(iv) Fa(—1) = Fa—a(-1) = nm — (-1)" 55 Fa(1) = Fra(1) = nm + (-1)" 2. 


The proof is obvious from (12) and the 
properties of fo. Assertion (iv) ensures 
that the graphs of the F,, add up to one Y 
curve. By (ii), each F, is one to one 3m 
(strictly monotone) on J. Thus it has a \ 
strictly monotone inverse on the interval \ 
Jn = F,[[-1, 1]], ie., on the F,,-image of \ 
T. For simplicity, we consider only 


T= [-$.§] ma n= [3 


Gn) Fe) = ont. 


as shown on the Y-axis in Figure 26. On 
these, we define for x € Jo 


sing = Fj) '(z) (13) 


and O xX 


—1 Hl 
cosa = V1 —sin’ 2, (13) 


and for x € Jy 


sing = F,‘(z) (14) 


and FIGURE 26 


cosz = —V1—sin’z. (14’) 
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On the rest of E!, we define sinx and cos periodically by setting 
sin(x + 2n7) = sing and cos(x+2na)=cosz, n=0,+1,+2,.... (15) 


Note that by Theorem 3(iv), 


'(Q=m(§) = 


Thus (13) and (14) both yield sin 7/2 = 1 for the common endpoint 1/2 of Jo 
and J;, so the two formulas are consistent. We also have 


in agreement with (15). Thus the sine and cosine functions (briefly, s and c) 
are well defined on E?. 


Theorem 4. The sine and cosine functions (s and c) are differentiable, hence 
continuous, on all of E', with derivatives s' = c and c! = —s; that is, 


(sinx)’ = cosa and (cosx)/ = —sinz. 


Proof. It suffices to consider the intervals Jo and J;, for, by (15), all properties 
of s and ¢ repeat themselves, with period 27, on the rest of E!. 


By (13), 


.= 7° on Jo = | 2 “|, 


“23 
where Fo is differentiable on J = (—1, 1). Thus Theorem 3 of §2 shows that s 
is differentiable on Jp = (—7/2, 7/2) and that 


s‘(q) 


1 
= —— whenever p € I and q = Fo(p); 
Fo(p) 


i.e.,qg € J and p= s(q). However, by Theorem 3(iii), 


Fol) = = 


s'(q) = \/1—sin?qg =cosq=c(q), qé€ J. 


This proves the theorem for interior points of Jo as far as s is concerned. 
As 


Hence 


c= V1—s2 = (1—s7)2 on Jo (by (13)), 
we can use the chain rule (Theorem 3 in §1) to obtain 
il 


E= mC. — 5*)—2(—2s)s' = —s 
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on noting that s’ = c = (1—s?)? on Jo. Similarly, using (14), one proves that 
s’ =cand c = —s on J; (interior of J;). 
Next, let g be an endpoint, say, q = 7/2. We take the left derivative 


s'_(q) = Tina s(x) = s(q) 


By L’Hopital’s rule, we get 


s’ (q) = lim salts =. lim <7) 
z>q- 1 @—q7 


since s’ = c on Jo. However, s = Fy ' is left continuous at g (why?); hence so 
is c= V1 —s?. (Why?) Therefore, 


s’ (q) = lim c(x)=c(q), as required. 
@—q7 


Similarly, one shows that s‘,(q) = c(q). Hence s’(q) = c(q) and c’(q) = —s(q), 
as before. O 


The other trigonometric functions reduce to s and c by their defining for- 
mulas 


1 


sin x’ 


COS & 1 
tan xz = ——, cotx = ——, secx = ——,, and cosecz = 
COs & sin zx COS & 


so we shall not dwell on them in detail. The various trigonometric laws easily 
follow from our present definitions; for hints, see the problems below. 


Problems on Exponential and Trigonometric Functions 
. Verify formula (2). 

. Prove Note 1, as suggested (using Chapter 2, §§11-12). 

. Prove formulas (1) of Chapter 2, §§11-12 from our new definitions. 
Complete the missing details in the proofs of Theorems 2-4. 


Prove that 


(i) sin0O = sin(n7) = 0; 


ao Fk wo NY 


(ii) cosO = cos(2n7) = 1; 


(vi) |sinz| <1 and |cosz| <1 for x € E’. 
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6. Prove that 
(i) sin(—x) = —sinz and 
(ii) cos(—x) = cosa for x € E?. 


[Hint: For (i), let h(x) = sinx+sin(—2x). Show that h’ = 0; hence h is constant, say, 
h=qon E!. Substitute 2 = 0 to find g. For (ii), use (13)—(15).] 


7. Prove the following for x, y € E?: 


T 
(i) sin(a + y) =sinx cosy + cos sin y; hence sin (« + =] = Coen, 


1 
(ii) cos(a + y) = cosx cosy — sinx sin y; hence cos (« + =| =—sing. 


[Hint for (i): Fix 2, y and let p=a2+y. Define h: E! + E! by 
h(t) = sint cos(p — t) + costsin(p—t), t¢€ Et. 
Proceed as in Problem 6. Then let ¢ = z.| 


8. With J,, as in the text, show that the sine increases on J, if n is even 
and decreases if n is odd. How about the cosine? Find the endpoints 
of J,,. 
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Sets 
Cantor’s function, 186 
Cantor’s principle of nested closed sets, 
188 
Cantor’s set, 120 
Cartesian coordinates in C, 83 
Cartesian product of sets (x), 2 
intervals in E” as Cartesian products of 
intervals in E!, 76 
Cauchy criterion 
for function limits, 162 
for uniform convergence of sequences of 
functions, 231 
Cauchy form of the remainder term of 
Taylor expansions, 291 
Cauchy sequences in metric spaces, 141 
Cauchy’s convergence criterion for se- 
quences in metric spaces, 143 
Cauchy’s laws of the mean, 261 
Cauchy-Schwarz inequality 
in BE”, 67 
in Euclidean spaces, 88 
Center of an interval in FE”, 77 
Change of variable, admissible, 165 
Chain rule for differentiation of composite 
functions, 255 
Change of variables in definite integrals, 
282 
Characteristic functions of sets, 323 
Clopen 
sets in metric spaces, 103 
Closed 
curve, 211 
globe in a metric space, 97 
interval in an ordered field, 37 
interval in BE”, 77 
line segment in E”, 72 
sets in metric spaces, 103, 138 
Closures of sets in metric spaces, 137 
Closure laws 
in a field, 23 
in BE”, 65 
of integers in a field, 35 
of rationals in a field, 35 
Cluster points 
of sequences in E*, 60 
of sequences and sets in metric spaces, 
115 
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Commutative laws 
in a field, 23 
of addition of vectors in E”, 65 
of inner products of vectors in E”, 67 
Compact sets, 186, 193 
Cantor’s principle of nested closed sets, 
188 
are totally bounded, 188 
in E!, 195 
continuity on, 194 
generalized Heine—Borel theorem, 193 
Heine—Borel theorem, 324 
sequentially, 186 
Comparison test, 239 
refined, 245 
Complement of a set (—), 2 
Complete 
metric spaces, 143 
ordered fields, 38; see also Field, com- 
plete ordered 
Completeness axiom, 38 
Completion of metric spaces, 146 
Complex exponential, 173 
derivatives of the, 256 
Complex field, see C 
Complex functions, 170 
Complex numbers, 81. See also C 
conjugate of, 81 
imaginary part of, 81 
nth roots of, 85 
polar form of, 83 
real part of, 81 
trigonometric form of, 83 
Complex vector spaces, 87 
Componentwise 
continuity of functions, 172 
convergence of sequences, 121 
differentiation, 256 
integration, 282 
limits of functions, 172 


Composite functions, 163 
chain rule for derivatives of, 255 
continuity of, 163 
Concurrent sequences, 144 
Conditionally convergent series of func- 
tions, 237 
rearrangement of, 250 
Conjugate of complex numbers, 81 


Connected sets, 212 
arcs as, 214 
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arcwise-, 211 
curves as, 214 
polygon-, 204 
Continuous functions 
on metric spaces, 149 
differentiable functions are, 252 
left, 153 
relatively, 152 
right, 153 
uniformly, 197 
(weakly) absolutely continuous, 309 


Continuity. See also Continuous functions 
componentwise, 172 
in one variable, 174 
jointly, 174 
of addition and multiplication in E!, 168 
of composite functions, 163 
of inverse functions, 195, 207 
of the exponential function, 184 
of the logarithmic function, 208 
of the power function, 209 
of the standard metric on E!, 168 
of the sum, product, and quotient of 
functions, 170 
on compact sets, 194 
sequential criterion for, 161 
uniform, 197 


Contracting sequence of sets, 17 
Contraction mapping, 198 


Convergence of sequences of functions 
Cauchy criterion for uniform, 231 
convergence of integrals and derivatives, 

315 
pointwise, 228 
uniform, 228 
Convergence radius of power series, 243 


Convergence tests for series 
Abel’s test, 247 
comparison test, 239 
Dirichlet test, 248 
integral test, 327 
Leibniz test for alternating series, 248 
ratio test, 241 
refined comparison test, 245 
root test, 241 
Weierstrass M-test for functions, 240 


Convergent 
absolutely convergent series of functions, 
237 
conditionally convergent series of func- 
tions, 237 
sequences of functions, 228; see also 
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Limits of sequences of functions 
sequences in metric spaces, 115 
series of functions, 228; see also Limits 
of series of functions 
Convex sets, 204 
piecewise, 204 
Coordinate equations of a line in E”, 72 
Countable set, 18 
rational numbers as a, 19 
Countable union of sets, 20 
Covering, open, 192 
Cross product of sets (x), 2 
Curves, 211 
as connected sets, 214 
closed, 211 
length of, 300 
parametric equations of, 212 
tangent to, 257 


Darboux property, 203 
Bolzano theorem, 205 
of the derivative, 265 
de Moivre’s formula, 84 
Definite integrals, 279 
additivity of, 282 
change of variables in, 282 
dominance law for, 284 
first law of the mean for, 285 
integration by parts, 281 
linearity of, 280 
monotonicity law for, 284 
weighted law of the mean for, 286, 326 
Degenerate intervals in E”, 78 
Degree 
of a monomial, 173 
of a polynomial, 173 
Deleted 6-globes about points in metric 
spaces, 150 
Dense subsets in metric spaces, 139 
Density 
of an ordered field, 45 
of rationals in an Archimedean field, 45 
Dependent vectors 
in BE”, 69 
Derivatives of functions on E!, 251 
convergence of, 315 
Darboux property of, 265 
derivative of the exponential function, 
264 
derivative of the inverse function, 263 
derivative of the logarithmic function, 
263 
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derivative of the power function, 264 
with extended-real values, 259 
left, 252 
one-sided, 252 
right, 252 
Derived functions on E!, 251 
nth, 252 
Diagonal of an interval in £”, 77 
Diagonal process, Cantor’s, 21. See also 
Sets 
Diameter 
of sets in metric spaces, 109 
Difference 
of elements of a field, 26 
of sets (—), 2 
Differentials of functions on E!, 288 
of order n, 289 
Differentiable functions on E!, 251 
Cauchy’s laws of the mean, 261 
cosine function, 337 
are continuous, 252 
exponential function, 333 
infinitely, 292 
logarithmic function, 332 
n-times continuously, 292 
n-times, 252 
nowhere, 253 
Rolle’s theorem, 261 
sine function, 337 
Differentiation, 251 
chain rule for, 255 
componentwise, 256 
of power series, 319 
rules for sums, products, and quotients, 
256 
termwise differentiation of series, 318 
Directed 
lines in EB”, 74 
planes in E”, 74 
Direction vectors of lines in E”, 71 
Dirichlet function, 155, 329 
Dirichlet test, 248 
Disconnected sets, 212 
totally, 217 
Discontinuity points of functions on metric 
spaces, 149 
Discontinuous functions on metric spaces, 
149 
Discrete 
metric, 96 
metric space, 96 
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Disjoint sets, 2 
Distance 
between a point and a plane in E”, 76 
between sets in metric spaces, 110 
between two vectors in E”, 64 
between two vectors in Euclidean spaces, 
89 
in normed linear spaces, 92 
norm-induced, 92 
translation-invariant, 92 
Distributive laws 
in BE”, 65 
in a field, 24 
of inner products of vectors in E”, 67 
of union and intersection of sets, 7 
Divergent 
sequences in metric spaces, 115 
Domain 
of a relation, 9 
of a sequence, 15 
space of functions on metric spaces, 149 
Double limits of functions, 219, 221 
Double sequence, 20, 222, 223 
Dot product 
in C”, 87 
in BE”, 64 
Duality laws, de Morgan’s, 3. See also Sets 


e (the number), 122, 165, 293 
E! (the real numbers), 23. See also Field, 
complete ordered 
associative laws in, 23 
axioms of arithmetic in, 23 
axioms of order in, 24 
closure laws in, 23 
commutative laws in, 23 
continuity of addition and multiplication 
in, 168 
continuity of the standard metric on, 
168 
distributive law in, 24 
inverse elements in, 24 
monotonicity in, 24 
neighborhood of a point in, 58 
natural numbers in, 28 
neutral elements in, 23 
transitivity in, 24 
trichotomy in, 24 
E” (Euclidean n-space), 63. See also Vec- 
tors in &” 
convex sets in, 204 
as a Euclidean space, 88 
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as a normed linear space, 91 Equicontinuous functions, 236 

associativity of vector addition in, 65 Equivalence class relative to an equivalence 
additive inverses of vector addition, 65 relation, 13 

basic unit vector in, 64 generator of an, 13 

Bolzano-Weierstrass theorem, 136 representative of an, 13 

Cauchy-Schwarz inequality in, 67 Equivalence relation, 12 

closure laws in, 65 equivalence class relative to an, 13 


commutativity of vector addition in, 65 


Euclidean n-space, see E” 
componentwise convergence of sequences 


Euclidean spaces, 87 


boa. iat . as normed linear spaces, 91 
distributive laws in, 65 j 
: absolute value in, 88 
globe in, 76 CO” as a. 88 
oo in, 72; see also Planes in Cauchy Schwan iiedualiieth, Be 


distance in, 89 

E” as a, 88 

line segments in, 89 
lines in, 89 

planes in, 89 

triangle inequality in, 88 


intervals in, 76; see also Intervals in E” 

line segments in, 72; see also Line seg- 
ments in &” 

linear functionals on, 74, 75; see also 
Linear functionals on E” 

lines in, 71; see also Lines in E” 

neutral element of vector addition in, 65 

planes in, 72; see also Planes in E” 


Exact primitive, 278 


Existential quantifier (4), 4 


point in, 63 Expanding sequence of sets, 17 
scalar of, 64 Exponential, complex, 173 
scalar product in, 64 Exponential function, 183, 333 
sphere in, 76 continuity of the, 184 
standard metric in, 96 derivative of the, 264 
standard norm in, 91 inverse of the, 208 
triangle inequality of the absolute value Extended real numbers, see E*. 
in, 67 


triangle inequality of the distance in, 68 
unit vector in, 65 

vectors in, 63 

zero vector in, 63 


Factorials, definition of, 31 
Family of sets, 3 
intersection of a ((}), 3 


union of a (LU), 3 
E* (extended real numbers), 53 Fields, 35 


as a metric space, 98 

cluster point of a sequence in, 60 
globes in, 98 

indeterminate expressions in, 178 
intervals in, 54 

limits of sequences in, 58 

metrics for, 99 

neighborhood of a point in, 58 
operations in, 177 

unorthodox operations in, 180 


associative laws in, 23 
axioms of arithmetic in, 23 
binomial theorem, 34 
closure laws in, 23 
commutative laws in, 23 
difference of elements in, 26 
distributive law in, 24 
first induction law in, 28 
inductive definitions in, 31 
inductive sets in, 28 
Edge-lengths of an interval in E”, 77 integers in, 34 
Elements of a set (€), 1 inverse elements in, 24 
irrationals in, 34 
Hmpty net (il); 4 Lagrange identity in, 71 
natural elements in, 28 
neutral elements in, 23 
quotients of elements in, 26 
Equality of sets, 1 rational subfields of, 35 


Endpoints 
of an interval in E”, 77 
of line segments in E”, 72 
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rationals in, 34 
Fields, Archimedean, 43. See also Fields, 
ordered 
density of rationals in, 45 
integral parts of elements of, 44 
Fields, complete ordered, 38. See also 
Field, Archimedean 
Archimedean property of, 43 
completeness axiom, 38 
density of irrationals in, 51 
existence of irrationals in, 46 
powers with rational exponents in, 47 
powers with real exponents in, 50 
principle of nested intervals in, 42 
roots in, 46 
Fields, ordered, 25. See also Field 
absolute value in, 26 
axioms of order in, 24 
Bernoulli inequalities in, 33 
bounded sets in, 36 
closed intervals in, 37 
density of, 45 
greatest lower bound (glb) of sets in, 38 
half-closed intervals in, 37 
half-open intervals in, 37 
infimum (inf) of sets in, 38 
intervals in, 37 
least upper bound (lub) of sets in, 37 
monotonicity in, 24 
negative elements in, 25 
open intervals in, 37 
positive elements in, 25 
rational subfield in, 35 
second induction law in, 30 
supremum (sup) of sets in, 38 
transitivity in, 24 
trichotomy in, 24 
well-ordering of naturals in, 30 
Finite 
increments law, 271 
intervals, 54 
sequence, 16 
set, 18 
First 
induction law, 28 
law of the mean, 285 
Functions, 10. See also Functions on E! 
and Functions on metric spaces 
binary operations, 12 
bounded, 96 
Cantor’s function, 186 
characteristic, 323 
complex, 170 


Index 


Dirichlet function, 155, 329 

equicontinuous, 236 

graphs of, 153 

isometry, 201 

limits of sequences of, see Limits of se- 
quences of functions 

limits of series of, see Limits of series of 
functions 

monotone, 181 

nondecreasing, 181 

nonincreasing, 181 

one-to-one, 10 

onto, 11 

product of, 170 

quotient of, 170 

real, 170 

scalar-valued, 170 

sequences of, 227; see also Sequences of 
functions 

series of, 228; see also Limits of series of 
functions 

signum function (sgn), 156 

strictly monotone, 182 

sum of, 170 

function value, 10 

uniformly continuous, 197 

vector-valued, 170 


Functions on E! 


antiderivatives of, 278 

definite integrals of, 279 

derivatives of, 251 

derived, 251 

differentials of, 288; see also Differentials 
of functions on E! 

differentiable, 251; see also Differentiable 
functions on E! 

exact primitives of, 278 

of bounded variation, 303 

indefinite integrals of, 278 

integrable, 278; see also Integrable func- 
tions on Et 

length of, 301 

Lipschitz condition for, 258 

negative variation functions for, 308 

nowhere differentiable, 253 

positive variation functions for, 308 

primitives of, 278 

regulated, see Regulated functions 

simple step, 323 

step, 323 

total variation of, 301 

(weakly) absolutely continuous, 309 


Functions on metric spaces,149 


Index 


bounded, 111 

continuity of composite, 163 

continuity of the sum, product, and quo- 
tient of, 170 

continuous, 149 

discontinuous, 149 

discontinuity points of, 149 

domain space of, 149 

limits of, 150 

projection maps, 174, 198, 226 

range space of, 149 


General term of a sequence, 16 
Generator of an equivalence class, 13 
Geometric series 
limit of, 128, 236 
sum of n terms of a, 33 
Globes 
closed globes in metric spaces, 97 
deleted 6-globes about points in metric 
spaces, 150 
in BE”, 76 
in E*, 98 
open globes in metric space, 97 
Graphs of functions, 153 
Greatest lower bound (glb) of a set in an 
ordered field, 38 


Half-closed 
interval in an ordered field, 37 
interval in E”, 77 
line segment in E”, 72 
Half-open 
interval in an ordered field, 37 
interval in E”, 77 
line segment in E”, 72 
Harmonic series, 241 
Hausdorff property, 102 
Heine—Borel theorem, 324 
generalized, 193 
Holder’s inequality, 93 
Hyperharmonic series, 245, 329 
Hyperplanes in E”, 72. See also Planes in 
BE 


iff (“if and only if”), 1 
Image 
of a set under a relation, 9 
Imaginary 
part of complex numbers, 81 
numbers in C, 81 
unit in C, 81 


347 


Inclusion relation of sets (C), 1 
Increments 
finite increments law, 271 
of a function, 254 
Independent 
vectors in &”, 70 
Indeterminate expressions in E*, 178 
Index notation, 16. See also Sequence 
Induction, 27 
first induction law, 28 
inductive definitions, 31; see also Induc- 
tive definitions 
proof by, 29 
second induction law, 30 
Inductive definitions, 31 
factorial, 31 
powers with natural exponents, 31 
ordered n-tuple, 32 
products of n field elements, 32 
sum of n field elements, 32 
Inductive sets in a field, 28 
Infimum (inf) of a set in an ordered field, 
38 
Infinite 
countably, 21 
intervals, 54 
sequence, 15 
set, 18 
Infinity 
plus and minus, 53 
unsigned, 179 
Inner products of vectors in E”, 64 
commutativity of, 67 
distributive law of, 67 
Integers in a field, 34 
closure of addition and multiplication of, 
35 
Integrability, sufficient conditions for, 322. 
See also Regulated functions on inter- 
vals in Et 
Integrable functions on E!, 278. See also 
Regulated functions on intervals in E+ 
Dirichlet function, 329 
primitively, 278 
Integral part of elements of Archimedean 
fields, 44 
Integral test of convergence of series, 315 
Integrals 
convergence of, 315 
definite, 279; see also Definite integrals 
indefinite, 278 
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Integration, 278 
componentwise, 282 
by parts, 281 
of power series, 319 
Interior 
of a set in a metric space, 101 
points of a set in a metric space, 101 
Intermediate value property, 203 
Intersection 
of a family of sets (()), 3 
of closed sets in metric spaces, 104 
of open sets in metric spaces, 103 
of sets (NM), 2 
Intervals in E”, 76 
boundary of, 77 
center of, 77 
closed, 77 
degenerate, 78 
diagonal of, 77 
edge-lengths of, 77 
endpoints of, 77 
half-closed, 77 
half-open, 77 
midpoints of, 77 
open, 77 
principle of nested, 189 
volume of, 77 
Intervals in Et 
partitions of, 300 
Intervals in E*, 54 
finite, 54 
infinite, 54 
Intervals in an ordered field, 37 
closed, 37 
half-closed, 37 
half-open, 37 
open, 37 
principle of nested, 42 
Inverse elements 
in a field, 24 
of vector addition in E”, 64, 65 
Inverse function, see Inverse of a relation 
continuity of the, 195, 207 derivative of 
the, 263 
Inverse image of a set under a relation, 9 
Inverse pair, 8 
Inverse of a relation, 8 
Irrationals 
density of irrationals in a complete field, 
51 
existence of irrationals in a complete 
field, 46 
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in a field, 34 
Isometric metric spaces, 146 
Isometry, 201. See also Functions 
Iterated limits of functions, 221, 221 


Jumps of regulated functions, 330 
Kuratowski’s definition of ordered pairs, 7 


Lagrange form of the remainder term of 
Taylor expansions, 291 
Lagrange identity, 71 
Lagrange’s law of the mean, 262 
Laws of the mean 
Cauchy’s, 261 
first, 285 
Lagrange’s, 262 
second, 286, 326 
weighted, 286, 326 
Leading term of a polynomial, 173 
Least upper bound (lub) of a set in an or- 
dered field, 37 
Lebesgue number of a covering, 192 
Left 
bounded sets in an ordered field, 36 
continuous functions, 153 
derivatives of functions, 252 
jump of a function, 184 
limits of functions, 153 
Leibniz 
formula for derivatives of a product, 256 
test for convergence of alternating series, 
248 
Length 
function, 308 
of arcs, 301, 311 
of curves, 300 
of functions, 301 
of line segments in E”, 72 
of polygons, 300 
of vectors in E”, 64 
L’H6pital’s rule, 266 
Limits of functions 
Cauchy criterion for, 162 
componentwise, 172 
double, 219, 221 
iterated, 221, 221 
jointly, 174 
left, 153 
on &*, 151 
in metric spaces, 150 


Index 


limits in one variable, 174 
L’H6pital’s rule, 266 
relative, 152 
relative, over a line, 174 
right, 153 
subuniform, 225 
uniform, 220, 230 
Limits of sequences 
in £1, 5, 54 
in &*, 55, 58, 152 
in metric spaces, 115 
lower, 56 
subsequential limits, 135 
upper, 56 
Limits of sequences of functions 
pointwise, 228 
uniform, 228 
Limits of series of functions 
pointwise, 228 
uniform, 228 
Weierstrass M-test, 240 
Linear combinations of vectors in E”, 66 
Line segments in £”, 72 
closed, 72 
endpoints of, 72 
half-closed, 72 
half-open, 72 
length of, 72 
midpoint of, 72 
open, 72 
principle of nested, 205 
Linear functionals on E”, 74, 75 
equivalence between planes and nonzero, 
76 
representation theorem for, 75 
Linear polynomials, 173 
Linear spaces, see Vector spaces 
Linearity of the definite integral, 280 
Lines in E”, 71 
coordinate equations of, 72 
directed, 74 
direction vectors of, 71 
normalized equation of, 73 
parallel, 74 
parametric equations of, 72 
perpendicular, 74 
symmetric form of the normal equations 
of, 74 
Lipschitz condition, 258 
Local 
maximum and minimum of functions, 
260 
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Logarithmic function, 208 
continuity of the, 208 
derivative of the, 263 
integral definition of the, 331 
as the inverse of the exponential func- 
tion, 208 
natural logarithm (In x), 208 
properties of the, 332 
Logical formula, negation of a, 5 
Logical quantifier, see Quantifier, logical 
Lower bound of a set in an ordered field, 


36 


Lower limit of a sequence, 56 


Maclaurin series, 294 

Mapping, see Function 

contraction, 198 

projection, 174, 198, 226 

Master set, 2 

Maximum 

local, of a function, 260, 294 

of a set in an ordered field, 36 
Mean, laws of. See Laws of the mean 


Metrics, 95. See also Metric spaces 
axioms of, 95 
discrete, 96 
equivalent, 219 
for E*, 99 
standard metric in E”, 96 
Metric spaces, 95. See also Metrics 
accumulation points of sets or sequences 
in, 115 
boundaries of sets in, 108 
bounded functions on sets in, 111 
bounded sequences in, 111 
bounded sets in, 109 
Cauchy sequences in, 141 
Cauchy’s convergence criterion for se- 
quences in, 143 
clopen sets in, 103 
closed balls in, 97 
closed sets in, 103, 138 
closures of sets in, 137 
compact sets in, 186 
complete, 143 
completion of, 146 
concurrent sequences in, 144 
connected, 212 
constant sequences in, 116 
continuity of the metric on, 223 
convergent sequences in, 115 
cluster points of sets or sequences in, 
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115 
deleted 6-globes about points in, 150 
diameter of sets in, 109 
disconnected, 212 
dense subsets in, 139 
discrete, 96 
distance between sets in, 110 
divergent sequences in, 115 
E&” as a metric space, 96 
E* as a metric space, 98 
functions on, 149; see also Functions on 
metric spaces 
Hausdorff property in, 102 
interior of a set in a, 101 
interior points of sets in, 101 
isometric, 146 
limits of sequences in, 115 
nowhere dense sets in, 141 
open balls in, 97 
open sets in, 101 
open globes in, 97 
neighborhoods of points in, 101 
perfect sets in, 118 
product of, 218 
sequentially compact sets in, 186 
spheres in, 97 
totally bounded sets in, 113 
Midpoints 
of line segments in E”, 72 
of intervals in E”, 77 
Minimum 
local, of a function, 260, 294 
of a set in an ordered field, 36 
Minkowski inequality, 94 
Monomials in n variables, 173. See also 
Polynomials in n variables 
degree of, 173 
Monotone sequence of numbers, 17 
nondecreasing, 17 
nonincreasing, 17 
strictly, 17 
Monotone functions, 181 
left and right limits of, 182 
nondecreasing, 181 
nonincreasing, 181 
strictly, 182 


Monotone sequence of sets, 17 


Monotonicity 
in an ordered field, 24 
of definite integrals, 284 


Moore-Smith theorem, 223 
de Morgan’s duality laws, 3. See also Sets 
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Natural elements in a field, 28 

well-ordering of naturals in an ordered 
field, 30 

Natural numbers in E!, 28 

Negation of a logical formula, 5 

Negative 

elements of an ordered field, 25 

variation functions, 308 

Neighborhood 

of a point in E!, 58 

of a point in E*, 58 

of a point in a metric space, 101 


Neutral elements 

in a field, 23 

of vector addition in E”, 65 
Nondecreasing 

functions, 181 

sequences of numbers, 17 
Nonincreasing 

functions, 181 

sequences of numbers, 17 
Normal to a plane in £”, 73 
Normalized equations 

of a line, 73 

of a plane, 73 


Normed linear spaces, 90 
absolute value in, 90 
C™ as a, 91 
distances in, 92 
E” as a, 91 
Euclidean spaces as, 91 
norm in, 90 
translation-invariant distances in, 92 
triangle inequality in, 90 
Norms 
in normed linear spaces, 90 
standard norm in C”, 91 
standard norm in £”, 91 


Nowhere dense sets in metric spaces, 141 


Open 
ball in a metric space, 97 
covering, 192 
globe in a metric space, 97 
interval in an ordered field, 37 
interval in E”, 77 
line segment in E”, 72 
sets in a metric space, 101 
Ordered field, see Field, ordered 
Ordered n-tuple, 1 
inductive definition of an, 32 
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Ordered pair, 1 

inverse, 8 

Kuratowski’s definition of an, 7 
Orthogonal vectors in FE”, 65 
Orthogonal projection 

of a point onto a plane in E”, 76 
Osgood’s theorem, 221, 223 


Parallel 
lines in £”, 74 
planes in E”, 74 
vectors in EB”, 65 
Parametric equations 
of curves in £”, 212 
of lines in FE”, 72 
Partitions of intervals in E!, 300 
refinements of, 300 
Pascal’s law, 34 
Peano form of the remainder term of Tay- 
lor expansions, 296 
Perfect sets in metric spaces, 118 
Cantor’s set, 120 
Perpendicular 
lines in £”, 74 
planes in E”, 74 
vectors in EB”, 65 
Piecewise convex sets, 204 
Planes in E”, 72 
directed, 74 
distance between points and, 76 
equation of, 73 
equivalence of nonzero linear functionals 
and, 76 
general equation of, 73 
normal to, 73 
normalized equations of, 73 
orthogonal projection of a point onto, 76 
parallel, 74 
perpendicular, 74 
Point in E”, 63 
distance from a plane to a, 76 
orthogonal projection onto a plane, 76 
Pointwise limits 
of sequences of functions, 228 
of series of functions, 228 
Polar coordinates in C’, 83 
Polar form of complex numbers, 83 
Polygons 
connected sets, 204 
joining two points, 204 
length of, 300 
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Polygon-connected sets, 204 
Polynomials in n variables, 173 
continuity of, 173 
degree of, 173 
leading term of, 173 
linear, 173 
Positive 
elements of an ordered field, 25 
variation functions, 308 
Power function, 208 
continuity of the, 209 
derivative of the, 264 
Power series, 243 
Abel’s theorem for, 249 
differentiation of, 319 
integration of, 319 
radius of convergence of, 243 
Taylor series, 292 
Powers 
with natural exponents in a field, 31 
with rational exponents in a complete 
field, 47 
with real exponents in a complete field, 
50 
Primitive, 278. See also Integral, indefinite 
exact, 278 
Principle of nested 
closed sets, 188 
intervals in complete ordered fields, 189 
intervals in E”, 189 
intervals in ordered fields, 42 
line segments, 205 
Products of functions, 170 
derivatives of, 256 
Leibniz formula for derivatives of, 256 
Product of metric spaces, 218 
Projection maps, 174, 198, 226 
Proper subset of a set (C), 1 


Quantifier, logical, 3 
existential (4), 4 
universal (V), 4 
Quotient of elements of a field, 26 
Quotient of functions, 170 
derivatives of, 256 


Radius of convergence of a power series, 
243 
Range 
of a relation, 9 
of a sequence, 16 
space of functions on metric spaces, 149 
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Ratio test for convergence of series, 241 
Rational functions, 173 
continuity of, 173 
Rational numbers, 19 
as a countable set, 19 
Rationals 
closure laws of, 35 
density of rationals in an Archimedean 
field, 45 
incompleteness of, 47 
in a field, 34 
as a subfield, 35 
Real 
functions, 170 
numbers, see E! 
part of complex numbers, 81 
points in C, 81 
vector spaces, 87 
unit in C, 81 
Rearrangement 
of absolutely convergent series of func- 
tions, 238 
of conditionally convergent series of 
functions, 250 
Rectifiable 
arc, 309 
set, 303 
Recursive definition, 31. See also Inductive 
definition 
Refined comparison test for convergence of 
series, 245 
Refinements of partitions in E!, 300 
Reflexive relation, 12 
Regulated functions on intervals in £1, 323 
approximation by simple step functions, 
324 
characteristic functions of intervals, 323 
jumps of, 330 
are integrable, 325 
simple step functions, 323 
Relation, 8. See also Sets 
domain of a, 9 
equivalence, 12 
image of a set under a, 9 
inverse, 8 
inverse image of a set under a, 9 
range of a, 9 
reflexive, 12 
symmetric, 12 
transitive, 12 
Relative 
continuity of functions, 152, 174 


Index 


limits of functions, 152, 174 
Remainder term of Taylor expansions, 289 

Cauchy form of the, 291 

integral form of the, 289 

Lagrange form of the, 291 

Peano form of the, 296 

Schloemilch—Roche form of the, 296 
Representative of an equivalence class, 13 
Right 

bounded sets in an ordered field, 36 

continuous functions, 153 

derivatives of functions, 252 

jump of a function, 184 

limits of functions, 153 
Rolle’s theorem, 261 
Root test for convergence of series, 241 
Roots 

in C, 85 

in a complete field, 46 


Scalar field of a vector space, 86 
Scalar products 
in BE”, 64 
Scalar-valued functions, 170 
Scalars 
of E”, 64 
of a vector space, 86 
Schloemilch—Roche form of the remainder 
term of Taylor expansions, 296 
Second induction law, 30 
Second law of the mean, 286, 326 
Sequences, 15 
bounded, 111 
Cauchy, 141 
Cauchy’s convergence criterion for, 143 
concurrent, 144 
constant, 116 
convergent, 115 
divergent, 115 
domain of, 15 
double, 20, 222, 223 
cluster points of sequences in E*, 60 
finite, 16 
general terms of, 16 
index notation, 16 
infinite, 15 
limits of sequences in E!, 5, 54 
limits of sequences in E*, 55, 58, 152 
limits of sequences in metric spaces, 115 
lower limits of, 56 
monotone sequences of numbers, 17 
monotone sequences of sets, 17 


Index 


nondecreasing sequences of numbers, 17 
nonincreasing sequences of numbers, 17 
range of, 16 
of functions, 227; see also Sequences of 
functions 
strictly monotone sequences of numbers, 
17 
subsequences of, 17 
subsequential limits of, 135 
totally bounded, 188 
upper limits of, 56 
Sequences of functions 
limits of, see Limits of sequences of 
functions 
uniformly bounded, 234 
Sequential criterion 
for continuity, 161 
for uniform continuity, 203 
Sequentially compact sets, 186 
Series. See also Series of functions 
Abel’s test for convergence of, 247 
alternating, 248 
geometric, 128, 236 
harmonic, 241 
hyperharmonic, 245, 329 
integral test of convergence of, 327 
Leibniz test for convergence of alternat- 
ing series, 248 
ratio test for convergence of, 241 
refined comparison test, 245 
root test for convergence of, 241 
summation by parts, 247 


Series of functions, 228; see also Limits of 
series of functions 
absolutely convergent, 237 
conditionally convergent, 237 
convergent, 228 
Dirichlet test, 248 
differentiation of, 318 
divergent, 229 
integration of, 318 
limit of geometric series, 128 
power series, 243; see also Power series 
rearrangement of, 238 
sum of n terms of a geometric series, 33 
Sets, 1 
Cantor’s diagonal process, 21 
Cantor’s set, 120 
Cartesian product of (x), 2 
characteristic functions of, 323 
compact, 186, 193 
complement of a set (—), 2 
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connected, 212 
convex, 204 
countable, 18 
countable union of, 20 
cross product of (x), 2 
diagonal process, Cantor’s, 21 
difference of (—), 2 
disjoint, 2 
distributive laws of, 7 
contracting sequence of, 17 
elements of (€), 1 
empty set (0), 1 
equality of, 1 
expanding sequence of, 17 
family of, 3 
finite, 18 
inclusion relation of, 1 
infinite, 18 
intersection of a family of (()), 3 
intersection of (M), 2 
master set, 2 
monotone sequence of, 17 
de Morgan’s duality laws, 3 
perfect sets in metric spaces, 118 
piecewise convex, 204 
polygon-connected, 204 
proper subset of a set (C), 1 
rectifiable, 303 
relation, 8 
sequentially compact, 186 
subset of a set (C), 1 
superset of a set (D), 1 
uncountable, 18 
union of a family of (UJ), 3 
union of (U), 2 
Signum function (sgn), 156 
Simple arcs, 211 
endpoints of, 211 
Simple step functions, 323 
approximating regulated functions, 324 
Singleton, 103 
Span of a set of vectors in a vector space, 
90 
Sphere 
in E”, 76 
in a metric space, 97 
Step functions, 323 
simple, 323 
Strictly monotone functions, 182 
Subsequence of a sequence, 17 
Subsequential limits, 135 
Subset of a set (C), 1 
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proper (C), 1 
Subuniform limits of functions, 225 
Sum of functions, 170 
Summation by parts, 247 
Superset of a set (D), 1 
Supremum (sup) of a bounded set in an 
ordered field, 38 
Symmetric relation, 12 


Tangent 
lines to curves, 257 
vectors to curves, 257 
unit tangent vectors, 314 
Taylor. See also Taylor expansions 
expansions, 289 
polynomial, 289 
series, 292; see also power series 
series about zero (Maclaurin series), 294 
Taylor expansions, 289. See also Remain- 
der term of Taylor expansions 
for the cosine function, 297 
for the exponential function, 293 
for the logarithmic function, 298 
for the power function, 298 
for the sine function, 297 
‘Termwise 
differentiation of series of functions, 318 
integration of series of functions, 318 
Total variation, 301 
additivity of, 301 
function, 308 
Totally bounded sets in metric spaces, 113 
Totally disconnected sets, 217 
Transitive relation, 12 
Transitivity in an ordered field, 24 
Triangle inequality 
in Euclidean spaces, 88 
in normed linear spaces, 90 
of the absolute value in E”, 67 
of the distance in E”, 68 
Trichotomy in an ordered field, 24 
Trigonometric form of complex numbers, 
83 
Trigonometric functions 
arcsine, 334 
cosine, 336 
integral definitions of, 334 
sine, 336 


Uncountable set, 18 
Cantor’s diagonal process, 21 
the real numbers as a, 20 


Index 


Uniform continuity, 197 
sequential criterion for, 203 
Uniform limits 
of functions, 220, 230 
of sequences of functions, 228 
of series of functions, 228 
Uniformly continuous functions, 197 
Union 
countable, 20 
of a family of sets (LU), 3 
of closed sets in metric spaces, 104 
of open sets in metric spaces, 103 
of sets (U), 2 
Unit vector 
tangent, 314 
in BE”, 65 
Universal quantifier (V), 4 


Ca 


northodox operations in E*, 180 


Upper bound of a set in an ordered field, 
36 


pper limit of a sequence, 56 


= 


Variation 
bounded, 303 
negative variation functions, 308 
positive variation functions, 308 
total; see Total variation 
Vector-valued functions, 170 
Vectors in E”, 63 
absolute value of, 64 
angle between, 70 
basic unit, 64 
components of, 63 
coordinates of, 63 
dependent, 69 
difference of, 64 
distance between two, 64 
dot product of two, 64 
independent, 70 
inner product of two, 64; see also Inner 
products of vectors in E” 
inverse of, 65 
length of, 64 
linear combination of, 66 
orthogonal, 65 
parallel, 65 
perpendicular, 65 
sum of, 64 
unit, 65 
zero, 63 
Vector spaces, 86 
complex, 87 


Index 


Euclidean spaces, 87 

normed linear spaces, 90 

real, 87 

scalar field of, 86 

span of a set of vectors in, 90 
Volume of an interval in E”, 77 

additivity of the, 79 


Weierstrass M-test for convergence of se- 
ries, 240 

Weighted law of the mean, 286, 326 

Well-ordering property, 30 


Zero vector in E”, 63 


399 


